00000001:02000400:3.0F:1789135639.341697:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789135662.853409:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789135665.718941:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 482 MB/s 00000001:01000000:2.0:1789135665.969565:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 655 MB/s 00000001:01000000:0.0:1789135666.222191:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2031 MB/s 00000020:02000000:2.0:1789135667.820636:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_127_ged01a19 00000400:02000000:2.0:1789135669.098800:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.141@tcp [8/256/0/180] 00008000:02000000:2.0:1789135673.935849:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789135734.629884:0:5254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1789135744.719909:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789135744.719918:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789135744.720035:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001f9b751a 00000080:02000400:1.0:1789135744.720046:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789135744.723994:0:5831:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789135744.724006:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789135744.724043:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000009bc1a18) 00000020:00000080:1.0:1789135744.724063:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789135744.741561:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789135744.742052:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789135744.784049:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789135744.784093:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789135744.784112:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789135744.784231:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789135744.784396:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789135744.786039:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789135744.786049:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789135744.786061:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95cad 00000020:01000004:0.0:1789135744.786069:0:5831:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789135744.786075:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789135744.786079:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001f9b751a from MGS 00000020:01000004:0.0:1789135744.786083:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789135744.786100:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009f8a6a4d) 00000020:00000080:0.0:1789135744.786112:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789135744.786229:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f9b751a from MGS, refs=2 00080000:01000000:0.0:1789135744.786234:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789135744.786239:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95cbb 00000100:00100000:0.0:1789135744.787921:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789135744.788209:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789135744.788216:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789135744.789231:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789135744.789239:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789135744.790455:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135744.790905:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789135744.790911:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789135744.791937:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789135744.791946:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789135744.800022:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789135744.800036:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789135744.801193:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135744.801197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135744.801199:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135744.801449:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135744.801451:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135744.801453:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135744.802370:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789135744.807911:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789135745.051915:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2915 MB/s 00000001:01000000:0.0:1789135745.301962:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3995 MB/s 00000001:01000000:3.0:1789135745.551813:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 547 MB/s 00000001:01000000:2.0:1789135745.808677:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 607 MB/s 00080000:10000000:3.0:1789135745.819694:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1789135745.835895:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789135745.835923:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789135745.835926:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789135745.836794:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789135745.836866:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789135745.836909:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789135745.837099:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789135745.837124:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789135745.837476:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135745.837667:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789135745.837674:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789135745.838692:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789135745.838739:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789135745.839137:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789135745.839144:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789135745.839881:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789135745.840028:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.141@tcp' 00000020:01000004:0.0:1789135745.840031:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789135745.840092:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.141@tcp (typ=mgc) 00000020:00000080:0.0:1789135745.840106:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.141@tcp (0000000090eee1c7) 00000020:00000080:0.0:1789135745.840124:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789135745.840198:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002492e274@MGC192.168.204.141@tcp: add connection 192.168.204.141@tcp at head 00010000:00010000:0.0:1789135745.840348:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.141@tcp-0 is initialized 00000040:01000000:0.0:1789135745.840355:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789135745.840658:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789135745.844204:0:5846:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789135745.844259:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.141@tcp (uuid 317c9ab4-7b59-4637-bad5-b8f09ce47a6a) 00000020:00000080:0.0:1789135745.844285:0:5831:0:(genops.c:1385:class_connect()) connect: client 317c9ab4-7b59-4637-bad5-b8f09ce47a6a, cookie 0x38eb79866bf95cc9 00000100:00080000:0.0:1789135745.844306:0:5831:0:(import.c:510:import_select_connection()) MGC192.168.204.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135745.844311:0:5831:0:(import.c:624:import_select_connection()) MGC192.168.204.141@tcp: import 000000002492e274 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:0.0:1789135745.847878:0:5831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058f5fba8 x1876044723257472/t0(0) o250->MGC192.168.204.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789135745.848147:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 317c9ab4-7b59-4637-bad5-b8f09ce47a6a->MGS 00000020:01000004:0.0:1789135745.848171:0:5831:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789135745.848178:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789135745.848193:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000040944388) 00000020:00000080:0.0:1789135745.848211:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789135745.851139:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058f5fba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3310:1876044723257472:0@lo:250: 00000100:00100000:2.0:1789135745.851242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135745.858079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723257472 00000100:00100000:3.0:1789135745.858096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723257472 00000100:00100000:3.0:1789135745.858161:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135745.858169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c79d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1876044723257472:12345-0@lo:250: 00010000:00080000:3.0:1789135745.858205:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 317c9ab4-7b59-4637-bad5-b8f09ce47a6a@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1789135745.858240:0:5842:0:(genops.c:1385:class_connect()) connect: client 317c9ab4-7b59-4637-bad5-b8f09ce47a6a, cookie 0x38eb79866bf95cd7 00000100:00080000:3.0:1789135745.858445:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000076fac14 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135745.858790:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c79d39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:3310:x1876044723257472:12345-0@lo:250: Request processed in 618us (7546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135745.858800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135745.858932:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789135745.858943:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1789135745.858952:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789135745.858957:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789135745.858961:0:3310:0:(import.c:65:import_set_state_nolock()) 000000002492e274 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789135745.858964:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789135745.858968:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789135745.858974:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058f5fba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3310:1876044723257472:0@lo:250: 00000100:00100000:0.0:1789135745.865148:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135745.866103:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789135745.866112:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:0.0:1789135745.874426:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135745.877796:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789135745.877813:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789135745.883381:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789135745.883394:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789135745.884996:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135745.885190:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789135745.885196:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789135745.886167:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789135745.886174:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789135745.937983:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135745.938201:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789135745.938208:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789135745.939755:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789135745.939766:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789135745.940597:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135745.940821:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135745.940827:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789135745.941880:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789135745.941891:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789135745.942831:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135745.943012:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135745.943017:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789135745.943776:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789135745.943784:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789135745.946951:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135745.947188:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135745.947196:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789135745.947884:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789135745.947891:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789135745.976531:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135745.976975:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789135745.976982:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789135745.983148:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789135745.983168:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789135745.985061:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789135745.985076:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789135745.986857:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789135745.986885:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789135745.986891:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789135745.987022:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789135745.987058:0:5831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.141@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789135745.987062:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789135745.987064:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135745.987065:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135745.987066:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135745.987068:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135745.987069:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135745.987070:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135745.987071:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135745.987073:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135745.987074:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135745.987075:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135745.987077:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135745.987079:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789135745.987088:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135745.987089:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135745.987090:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135745.987090:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135745.987091:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135745.987092:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135745.987093:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135745.987094:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135745.987094:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135745.987095:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135745.987096:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135745.987097:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135745.987127:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789135745.987147:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001003e4ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257600:0@lo:253: 00000100:00100000:2.0:1789135745.987236:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135745.987329:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89be68e going to sleep for 11 seconds 00000100:00100000:3.0:1789135745.987379:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723257600 00000100:00100000:3.0:1789135745.987387:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723257600 00000100:00100000:3.0:1789135745.987470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135745.987479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa42a33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:5831:x1876044723257600:12345-0@lo:253: 20000000:01000000:3.0:1789135745.987539:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789135745.987542:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789135745.988028:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789135745.988077:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789135745.988383:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135745.989446:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789135745.990062:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789135745.990066:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789135745.990071:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789135745.990074:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789135745.990089:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789135745.990308:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135745.990574:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789135745.990588:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789135745.990926:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789135745.990998:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789135745.991052:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789135745.991146:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789135745.991154:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789135745.991194:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789135745.991202:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789135745.991231:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789135745.991238:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789135745.991280:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789135745.991346:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789135745.991379:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789135745.991383:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789135745.991396:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135745.991608:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789135745.991618:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789135745.991950:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789135745.991988:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789135745.992038:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789135745.992051:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789135745.992126:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789135745.992135:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789135745.992195:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789135745.992238:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789135745.992273:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789135745.992283:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789135745.992356:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789135745.992365:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789135745.992394:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789135745.992442:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789135745.992614:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789135745.992887:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789135745.992895:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789135745.993320:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789135745.993610:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789135745.993888:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.141@tcp for mdt 20000000:01000000:2.0:1789135745.993890:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.141@tcp (null) (null) (null) 00000040:00080000:2.0:1789135745.993932:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789135745.993940:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789135745.993970:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789135745.993978:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.141@tcp (null) (null) 00000040:00080000:2.0:1789135745.994026:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789135745.994047:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789135745.994084:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789135745.994117:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789135745.994181:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789135745.994185:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789135745.994192:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789135745.994199:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789135745.994622:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1789135745.994854:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789135746.001172:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789135746.001227:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789135746.001321:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789135746.001342:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789135746.001345:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789135746.001349:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789135746.001375:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789135746.001378:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789135746.001409:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789135746.001412:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789135746.002300:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789135746.002591:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789135746.002799:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789135746.002866:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1789135746.002877:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789135746.002880:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789135746.003301:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789135746.003533:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789135746.003576:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789135746.003611:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789135746.003624:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135746.003692:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789135746.003925:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789135746.003947:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.003978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.003990:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.003996:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004003:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004010:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004016:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001aa1a765 already unused, calling callback (00000000c43687a6) 00010000:00010000:2.0:1789135746.004020:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004027:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004040:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004047:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.004052:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001aa1a765/0x38eb79866bf95cde lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135746.004078:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789135746.198524:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa42a33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:5831:x1876044723257600:12345-0@lo:253: Request processed in 211038us (211281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.198545:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135746.198663:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001003e4ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257600:0@lo:253: 10000000:01000000:1.0:1789135746.198681:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789135746.198684:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789135746.198687:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789135746.198688:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135746.198690:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789135746.198691:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135746.198692:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135746.198722:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789135746.198724:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789135746.198725:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789135746.198727:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135746.198728:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789135746.198751:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001f9b751a from lustre-MDT0000 10000000:01000000:1.0:1789135746.198775:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789135746.198778:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789135746.198782:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ba0592cced8 10000000:01000000:1.0:1789135746.198786:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135746.198793:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ba0592cced8 from 1 10000000:01000000:1.0:1789135746.198796:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789135746.198833:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.198843:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.198851:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135746.198869:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257728:0@lo:101: 00000100:00100000:1.0:1789135746.198916:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.198968:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.199118:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723257728 00000100:00100000:3.0:1789135746.199124:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723257728 00000100:00100000:3.0:1789135746.199163:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135746.199169:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c48bafa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:5831:x1876044723257728:12345-0@lo:101: 00010000:00010000:3.0:1789135746.199182:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135746.199193:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009500d9fd/0x38eb79866bf95cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95ce5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.199213:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009500d9fd/0x38eb79866bf95cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.199222:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009500d9fd/0x38eb79866bf95cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.199231:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009500d9fd, rc 0) 00000100:00100000:3.0:1789135746.199262:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c48bafa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5831:x1876044723257728:12345-0@lo:101: Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.199268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135746.199364:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257728:0@lo:101: 00010000:00010000:1.0:1789135746.199375:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.199383:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135746.199427:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257856:0@lo:501: 00000100:00100000:1.0:1789135746.199459:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.199478:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.199533:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723257856 00000100:00100000:0.0:1789135746.199537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723257856 00000100:00100000:0.0:1789135746.199567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135746.199572:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ada6585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5831:x1876044723257856:12345-0@lo:501: 00000100:00100000:0.0:1789135746.199840:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ada6585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5831:x1876044723257856:12345-0@lo:501: Request processed in 267us (379us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135746.199847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135746.199977:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257856:0@lo:501: 10000000:01000000:1.0:1789135746.199998:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789135746.200015:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200024:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 00000000b941ec56/0x38eb79866bf95ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135746.200031:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba04857c800 10000000:01000000:1.0:1789135746.200035:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789135746.200039:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ba04857c800 10000000:01000000:1.0:1789135746.200042:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789135746.200045:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ba04857c800 from 1 10000000:01000000:1.0:1789135746.200047:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789135746.200063:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200069:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200075:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135746.200086:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257984:0@lo:101: 00000100:00100000:1.0:1789135746.200112:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.200131:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.200194:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723257984 00000100:00100000:0.0:1789135746.200198:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723257984 00000100:00100000:0.0:1789135746.200229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135746.200236:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007289d28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5831:x1876044723257984:12345-0@lo:101: 00010000:00010000:0.0:1789135746.200243:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135746.200253:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f442755/0x38eb79866bf95cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95cf3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.200268:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f442755/0x38eb79866bf95cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95cf3 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.200275:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f442755/0x38eb79866bf95cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95cf3 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.200282:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f442755, rc 0) 00000100:00100000:0.0:1789135746.200307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007289d28d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:5831:x1876044723257984:12345-0@lo:101: Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.200312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135746.200382:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723257984:0@lo:101: 00010000:00010000:1.0:1789135746.200398:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200406:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135746.200417:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789135746.200434:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200440:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 00000000da82bb5f/0x38eb79866bf95cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135746.200447:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789135746.200450:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135746.200453:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ba04857c800 10000000:01000000:1.0:1789135746.200456:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789135746.200459:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789135746.200461:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135746.200474:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200480:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200486:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135746.200497:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258112:0@lo:101: 00000100:00100000:1.0:1789135746.200533:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.200549:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.200608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258112 00000100:00100000:3.0:1789135746.200612:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258112 00000100:00100000:3.0:1789135746.200650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135746.200663:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d66bfc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:5831:x1876044723258112:12345-0@lo:101: 00010000:00010000:3.0:1789135746.200670:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135746.200676:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cee1b530/0x38eb79866bf95d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95d01 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.200689:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cee1b530/0x38eb79866bf95d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.200695:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cee1b530/0x38eb79866bf95d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.200723:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cee1b530, rc 0) 00000100:00100000:3.0:1789135746.200751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d66bfc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+8:5831:x1876044723258112:12345-0@lo:101: Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.200757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135746.200882:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258112:0@lo:101: 00010000:00010000:1.0:1789135746.200892:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.200898:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135746.200933:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258240:0@lo:501: 00000100:00100000:1.0:1789135746.200958:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.200981:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.201036:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258240 00000100:00100000:0.0:1789135746.201040:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258240 00000100:00100000:0.0:1789135746.201069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135746.201075:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003ef60f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+8:5831:x1876044723258240:12345-0@lo:501: 00000100:00100000:0.0:1789135746.201252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003ef60f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5831:x1876044723258240:12345-0@lo:501: Request processed in 177us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.201259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135746.201334:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258240:0@lo:501: 00000100:00100000:1.0:1789135746.201357:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258368:0@lo:503: 00000100:00100000:1.0:1789135746.201389:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.201409:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d1055c going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.201456:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258368 00000100:00100000:0.0:1789135746.201460:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258368 00000100:00100000:0.0:1789135746.201486:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135746.201492:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b3bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5831:x1876044723258368:12345-0@lo:503: 00000100:00100000:0.0:1789135746.201767:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b3bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5831:x1876044723258368:12345-0@lo:503: Request processed in 275us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.201774:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135746.201844:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258368:0@lo:503: 00000100:00100000:1.0:1789135746.202221:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5874:1876044723258496:0@lo:502: 00000100:00100000:1.0:1789135746.202254:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135746.202284:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049690408 going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.202332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258496 00000100:00100000:0.0:1789135746.202336:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258496 00000100:00100000:0.0:1789135746.202368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135746.202374:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7115e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5874:x1876044723258496:12345-0@lo:502: 00000100:00100000:0.0:1789135746.202557:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7115e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5874:x1876044723258496:12345-0@lo:502: Request processed in 184us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.202564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135746.202834:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054ff5868 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5874:1876044723258496:0@lo:502: 00000020:01000000:3.0:1789135746.202857:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135746.202866:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135746.202869:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135746.202873:0:5874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789135746.202876:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135746.202896:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000af9b4e20) 00000020:00000080:3.0:1789135746.202916:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789135746.202922:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789135746.202991:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789135746.202998:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95d16 00000020:00000080:3.0:1789135746.203211:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789135746.203215:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135746.203218:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135746.203220:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135746.203226:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135746.203229:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135746.203231:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789135746.203234:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135746.203240:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000956b6e10) 00000020:00000080:3.0:1789135746.203249:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789135746.203252:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789135746.203254:0:5874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789135746.203256:0:5874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789135746.203261:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789135746.203299:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f9b751a from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789135746.203309:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000369e24c8) 00000020:00000080:3.0:1789135746.203315:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789135746.203365:0:5874:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789135746.203370:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf95d2b 00000020:00000080:3.0:1789135746.203461:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789135746.203466:0:5874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789135746.203469:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x38eb79866bf95d32 00080000:01000000:3.0:1789135746.203474:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789135746.203476:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95d39 00080000:10000000:3.0:1789135746.204067:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789135746.204594:0:5874:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789135746.208822:0:5874:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789135746.289533:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789135746.292046:0:5874:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789135746.295308:0:5874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789135746.312331:0:5874:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789135746.367666:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ce6fff2a) 00000020:00000080:0.0:1789135746.367690:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789135746.367790:0:5874:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789135746.367798:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95d47 00000020:00000080:1.0:1789135746.368366:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789135746.375756:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135746.418517:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135746.450101:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.480006:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.510492:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.537090:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789135746.570286:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x38eb79866bf95d4e 00000020:00000080:2.0:1789135746.570774:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789135746.570787:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135746.570795:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135746.570798:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789135746.570811:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135746.570818:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135746.570819:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789135746.570823:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789135746.570864:0:5874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789135746.570876:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135746.570879:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135746.570880:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789135746.570883:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135746.570885:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135746.570886:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135746.570888:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135746.570890:0:5874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789135746.570932:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5874:1876044723258624:0@lo:502: 00000100:00100000:2.0:1789135746.571015:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.571075:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89be68e going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.571209:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258624 00000100:00100000:3.0:1789135746.571218:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258624 00000100:00100000:3.0:1789135746.571267:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135746.571275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000065c0633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5874:x1876044723258624:12345-0@lo:502: 00000100:00100000:3.0:1789135746.571571:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000065c0633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5874:x1876044723258624:12345-0@lo:502: Request processed in 296us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.571585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135746.571752:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5874:1876044723258624:0@lo:502: 00000020:01000000:2.0:1789135746.571777:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135746.571786:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135746.571787:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789135746.571790:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789135746.572006:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789135746.572023:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789135746.572040:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.572050:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 00000000ebe97e8c/0x38eb79866bf95d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135746.572057:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba04857c800 from 1 10000000:01000000:3.0:1789135746.572060:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789135746.572088:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.572095:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.572103:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135746.572118:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258752:0@lo:101: 00000100:00100000:3.0:1789135746.572149:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135746.572170:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095a5c718 going to sleep for 11 seconds 00000100:00100000:1.0:1789135746.572248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258752 00000100:00100000:1.0:1789135746.572253:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258752 00000100:00100000:1.0:1789135746.572285:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135746.572292:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d953440c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:5831:x1876044723258752:12345-0@lo:101: 00010000:00010000:1.0:1789135746.572311:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135746.572323:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95d55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.572342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.572352:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135746.572360:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079d26867, rc 0) 00000100:00100000:1.0:1789135746.572389:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d953440c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:5831:x1876044723258752:12345-0@lo:101: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135746.572396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135746.572467:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258752:0@lo:101: 00010000:00010000:3.0:1789135746.572478:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.572486:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135746.573293:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258880:0@lo:256: 00000100:00100000:3.0:1789135746.573338:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135746.573561:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095a5c718 going to sleep for 11 seconds 00000100:00100000:1.0:1789135746.573774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723258880 00000100:00100000:1.0:1789135746.573779:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723258880 00000100:00100000:1.0:1789135746.573827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135746.573835:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b1b480b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:5831:x1876044723258880:12345-0@lo:256: 20000000:01000000:1.0:1789135746.573851:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789135746.573856:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789135746.573929:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b1b480b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:5831:x1876044723258880:12345-0@lo:256: Request processed in 96us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135746.573936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135746.574013:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723258880:0@lo:256: 10000000:01000000:2.0:1789135746.574572:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789135746.574592:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.574602:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135746.574610:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 1 10000000:01000000:2.0:1789135746.574613:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135746.574651:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.574658:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.574665:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135746.574684:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259008:0@lo:101: 00000100:00100000:2.0:1789135746.574740:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.574762:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89be68e going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.574827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259008 00000100:00100000:0.0:1789135746.574833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259008 00000100:00100000:0.0:1789135746.574865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135746.574873:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028c5f78b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:5831:x1876044723259008:12345-0@lo:101: 00010000:00010000:0.0:1789135746.574883:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135746.574896:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95d63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.574914:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.574937:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.574944:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e74e1380, rc 0) 00000100:00100000:0.0:1789135746.574981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028c5f78b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259008:12345-0@lo:101: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.574987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135746.575163:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259008:0@lo:101: 00010000:00010000:2.0:1789135746.575175:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.575183:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135746.575241:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259136:0@lo:501: 00000100:00100000:2.0:1789135746.575267:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.575290:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89be68e going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.575342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259136 00000100:00100000:3.0:1789135746.575346:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259136 00000100:00100000:3.0:1789135746.575492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135746.575510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d0725f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259136:12345-0@lo:501: 00000100:00100000:3.0:1789135746.576114:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d0725f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259136:12345-0@lo:501: Request processed in 605us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.576122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135746.576201:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259136:0@lo:501: 00000100:00100000:2.0:1789135746.576232:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259264:0@lo:503: 00000100:00100000:2.0:1789135746.576271:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.577407:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89be68e going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.577466:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259264 00000100:00100000:0.0:1789135746.577473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259264 00000100:00100000:0.0:1789135746.577522:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135746.577530:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c0fa67d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259264:12345-0@lo:503: 00000040:00080000:0.0:1789135746.577580:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135746.577772:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c0fa67d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259264:12345-0@lo:503: Request processed in 243us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.577779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135746.578099:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259264:0@lo:503: 00000040:00080000:1.0:1789135746.583144:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789135746.583352:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789135746.583379:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135746.583432:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.583445:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135746.583487:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789135746.583490:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba04857c800 10000000:01000000:2.0:1789135746.583493:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba04857c800 10000000:01000000:2.0:1789135746.583509:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135746.583515:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba04857c800 from 1 10000000:01000000:2.0:1789135746.583518:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135746.583560:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.583567:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.583594:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135746.583695:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259392:0@lo:101: 00000100:00100000:2.0:1789135746.583938:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.583994:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3bbab1 going to sleep for 11 seconds 00000100:00100000:0.0:1789135746.584059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259392 00000100:00100000:0.0:1789135746.584067:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259392 00000100:00100000:0.0:1789135746.584399:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135746.584409:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025f9660d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723259392:12345-0@lo:101: 00010000:00010000:0.0:1789135746.584427:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135746.584442:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000909f4b7a/0x38eb79866bf95d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95d71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.584470:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000909f4b7a/0x38eb79866bf95d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.584482:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000909f4b7a/0x38eb79866bf95d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.584510:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000909f4b7a, rc 0) 00000100:00100000:0.0:1789135746.584553:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025f9660d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723259392:12345-0@lo:101: Request processed in 146us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135746.584560:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135746.584649:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259392:0@lo:101: 00010000:00010000:2.0:1789135746.584663:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135746.584671:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135746.584751:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259520:0@lo:501: 00000100:00100000:2.0:1789135746.584778:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.585128:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3bbab1 going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.585180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259520 00000100:00100000:3.0:1789135746.585185:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259520 00000100:00100000:3.0:1789135746.585209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135746.585215:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d9ae2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723259520:12345-0@lo:501: 00000100:00100000:3.0:1789135746.585518:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d9ae2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723259520:12345-0@lo:501: Request processed in 302us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.585526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135746.585690:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259520:0@lo:501: 00000100:00100000:2.0:1789135746.585890:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259648:0@lo:503: 00000100:00100000:2.0:1789135746.585933:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.585999:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3bbab1 going to sleep for 11 seconds 00000100:00100000:1.0:1789135746.586044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259648 00000100:00100000:1.0:1789135746.586050:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259648 00000100:00100000:3.0:1789135746.586099:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135746.586107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db265e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723259648:12345-0@lo:503: 00000100:00100000:3.0:1789135746.586433:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db265e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723259648:12345-0@lo:503: Request processed in 327us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.586440:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135746.586579:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723259648:0@lo:503: 00000100:00100000:0.0:1789135746.587176:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000628a7b49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5879:1876044723259776:0@lo:502: 00000100:00100000:0.0:1789135746.587225:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135746.587296:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0edb07f going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.587338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259776 00000100:00100000:3.0:1789135746.587343:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259776 00000100:00100000:3.0:1789135746.587406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789135746.587420:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c92a9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5879:x1876044723259776:12345-0@lo:502: 00000100:00100000:3.0:1789135746.587658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c92a9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5879:x1876044723259776:12345-0@lo:502: Request processed in 240us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.587665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135746.587744:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000628a7b49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5879:1876044723259776:0@lo:502: 00000020:01000004:0.0:1789135746.587823:0:5879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789135746.587847:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e57162fe) 00000020:00000080:0.0:1789135746.587865:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789135746.587950:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f9b751a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789135746.587954:0:5879:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001f9b751a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789135746.587956:0:5879:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001f9b751a 4 00010000:00080000:0.0:1789135746.587985:0:5879:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ab009773@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:0.0:1789135746.589601:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789135746.590769:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789135746.590843:0:5879:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135746.590859:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x38eb79866bf95d86 00000100:00080000:1.0:1789135746.591155:0:5879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135746.591161:0:5879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ab009773 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:1.0:1789135746.591201:0:5879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a97bc44e x1876044723259904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135746.591232:0:5879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135746.592149:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a97bc44e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723259904:0@lo:38: 00000100:00100000:0.0:1789135746.592226:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135746.592341:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723259904 00000100:00100000:2.0:1789135746.592349:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723259904 00000100:00100000:2.0:1789135746.592389:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135746.592397:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628a7b49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723259904:12345-0@lo:38: 00000100:00100000:2.0:1789135746.592461:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628a7b49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723259904:12345-0@lo:38: Request processed in 65us (236us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789135746.592468:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135746.592548:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135746.592556:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000ab009773 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789135746.592561:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789135746.592563:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a97bc44e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723259904:0@lo:38: 00000100:00100000:3.0:1789135746.593028:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006092c8d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5879:1876044723260032:0@lo:502: 00000100:00100000:3.0:1789135746.593082:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135746.593109:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260032 00000100:00100000:3.0:1789135746.593113:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260032 00000100:00100000:3.0:1789135746.593146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135746.593153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a0bbb50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5879:x1876044723260032:12345-0@lo:502: 00000100:00100000:3.0:1789135746.593373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a0bbb50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5879:x1876044723260032:12345-0@lo:502: Request processed in 221us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.593380:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135746.593429:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd862e14 going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.593444:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006092c8d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5879:1876044723260032:0@lo:502: 00000040:00080000:3.0:1789135746.593467:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789135746.593527:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789135746.593543:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135746.593556:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.593567:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 0000000057e96eb3/0x38eb79866bf95d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135746.593608:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135746.593610:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135746.593611:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135746.593612:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135746.593694:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135746.593695:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135746.593696:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135746.593718:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135746.593720:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135746.593721:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135746.593722:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135746.593723:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135746.593727:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789135746.593730:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135746.593731:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135746.593732:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135746.593733:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135746.593733:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135746.593734:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135746.593735:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135746.593736:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135746.593737:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135746.593738:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135746.593738:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135746.593739:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135746.593752:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789135746.593760:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006092c8d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723260160:0@lo:253: 00000100:00100000:3.0:1789135746.593790:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135746.593887:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd862e14 going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.593909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260160 00000100:00100000:3.0:1789135746.593914:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260160 00000100:00100000:3.0:1789135746.593938:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135746.593944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001592b140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5831:x1876044723260160:12345-0@lo:253: 20000000:01000000:3.0:1789135746.593977:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789135746.593994:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789135746.677084:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789135746.677107:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789135746.677609:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789135746.677618:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789135746.677650:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.677735:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.677746:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.677788:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135746.677804:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 12 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135746.677819:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff2af175 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723260288:0@lo:104: 00000100:00100000:0.0:1789135746.677892:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135746.677968:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a328850c going to sleep for 11 seconds 00000100:00100000:3.0:1789135746.678198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260288 00000100:00100000:3.0:1789135746.678212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260288 00000100:00100000:3.0:1789135746.678284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135746.678307:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f201db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723260288:12345-0@lo:104: 00010000:00010000:3.0:1789135746.678323:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678398:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135746.678404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f201db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723260288:12345-0@lo:104: Request processed in 100us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.678416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789135746.678443:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135746.678449:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678457:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d654b8f7 already unused, calling callback (0000000004c401e6) 10000000:00010000:3.0:1789135746.678460:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678467:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135746.678474:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135746.678480:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789135746.678521:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678528:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135746.678546:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678552:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: 00000000d654b8f7/0x38eb79866bf95d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d5c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678582:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135746.678584:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135746.678585:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135746.678658:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb1dba75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723260416:0@lo:103: 00000100:00100000:3.0:1789135746.678689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135746.678791:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260416 00000100:00100000:3.0:1789135746.678795:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260416 00010000:00010000:3.0:1789135746.678810:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135746.678831:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135746.678836:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ed0ab8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3312:x1876044723260416:12345-0@lo:103: 00010000:00010000:3.0:1789135746.678845:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135746.678850:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678858:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 13 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678883:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.678890:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789135746.678901:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001285146s 00010000:00010000:3.0:1789135746.678905:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679408:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679414:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679420:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679425:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d3854fe already unused, calling callback (00000000c43687a6) 00010000:00010000:3.0:1789135746.679428:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679435:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679444:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679454:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135746.679508:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ed0ab8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3312:x1876044723260416:12345-0@lo:103: Request processed in 671us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135746.679517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789135746.679567:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079d26867/0x38eb79866bf95d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95d55 expref: 12 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135746.679578:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff2af175 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723260288:0@lo:104: 00010000:00010000:3.0:1789135746.679596:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679617:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679623:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135746.679629:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d3854fe/0x38eb79866bf95d8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135746.679743:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb1dba75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723260416:0@lo:103: 00000100:00100000:2.0:1789135746.688242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001592b140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5831:x1876044723260160:12345-0@lo:253: Request processed in 94291us (94443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135746.688264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135746.688371:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006092c8d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5831:1876044723260160:0@lo:253: 10000000:01000000:3.0:1789135746.688388:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789135746.688392:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135746.688393:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135746.688394:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135746.688396:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135746.688397:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135746.688399:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135746.688400:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135746.688401:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135746.688403:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135746.688404:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135746.688406:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135746.688408:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789135746.688427:0:5831:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789135746.694157:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.694601:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135746.694865:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.695046:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135746.695282:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.695490:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135746.699690:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.700221:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135746.700444:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.700655:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135746.703278:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135746.703620:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789135746.768994:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789135746.818667:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789135746.818683:0:5884:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789135746.818688:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789135746.819057:0:5885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789135746.821745:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789135746.821907:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789135746.822334:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789135746.822342:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789135746.830071:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135746.832537:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789135746.836537:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789135746.837782:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789135746.839136:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789135746.839860:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789135746.848060:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789135746.848275:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789135746.848423:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789135746.848604:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789135746.848808:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789135746.848947:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789135746.849101:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789135746.849242:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789135746.849420:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789135746.849585:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789135746.849772:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789135746.849915:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789135746.850064:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789135746.850198:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789135746.850359:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789135746.850513:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789135746.856410:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789135746.857366:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789135746.857771:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789135746.857963:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789135746.858122:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789135746.858267:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789135746.858446:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789135746.859422:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789135746.859665:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789135746.859851:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789135746.860274:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789135746.860424:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789135746.863207:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789135746.863474:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789135746.865211:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789135746.865407:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789135746.866092:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789135746.893234:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135746.905469:0:5885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789135746.980930:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789135746.980972:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb42301d9f988 00100000:10000000:0.0:1789135746.980981:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789135746.992638:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789135746.992658:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789135746.992672:0:5831:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789135746.992735:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789135747.061311:0:5885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789135747.061426:0:5885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1789135747.061431:0:5885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789135747.920847:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135748.941870:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135749.972578:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135750.989052:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135751.825083:0:6128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789135751.888252:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789135751.888264:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789135751.888267:0:38:0:(import.c:65:import_set_state_nolock()) 00000000ab009773 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135751.888288:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ab009773 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789135751.888318:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005976be5c x1876044723260672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135751.888361:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005976be5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723260672:0@lo:38: 00000100:00100000:3.0:1789135751.888445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.888466:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044100d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723260544:0@lo:400: 00000100:00100000:1.0:1789135751.888514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135751.888552:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260672 00000100:00100000:3.0:1789135751.888559:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260672 00000100:00100000:3.0:1789135751.888597:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135751.888604:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006092c8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723260672:12345-0@lo:38: 00010000:00080000:3.0:1789135751.888631:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1789135751.888669:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x38eb79866bf95d94 00000004:00100000:3.0:1789135751.888752:0:5852:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789135751.888915:0:5852:0:(import.c:65:import_set_state_nolock()) 00000000caf01c2c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135751.889034:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006092c8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876044723260672:12345-0@lo:38: Request processed in 428us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135751.889041:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135751.889067:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260544 00000100:00100000:3.0:1789135751.889071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260544 00000100:00100000:3.0:1789135751.889098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135751.889105:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044dfaf37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:3313:x1876044723260544:12345-0@lo:400: 00000100:00100000:3.0:1789135751.889140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044dfaf37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:3313:x1876044723260544:12345-0@lo:400: Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135751.889146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135751.889191:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044100d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723260544:0@lo:400: 00010000:00080000:1.0:1789135751.889341:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005976be5c x1876044723260672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789135751.889354:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789135751.889364:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789135751.889368:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789135751.889370:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000ab009773 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789135751.889374:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005976be5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723260672:0@lo:38: 00010000:00010000:2.0:1789135752.014568:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135753.043223:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789135753.932806:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789135753.932814:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba04857c800 from 3 10000000:01000000:3.0:1789135753.932829:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789135753.932873:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135753.932899:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135753.932911:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135753.932939:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044100d5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723260800:0@lo:101: 00000100:00100000:3.0:1789135753.933015:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135753.933092:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000834f11a2 going to sleep for 11 seconds 00000100:00100000:2.0:1789135753.933379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260800 00000100:00100000:2.0:1789135753.933388:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260800 00000100:00100000:2.0:1789135753.933442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135753.933450:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b5e8316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5846:x1876044723260800:12345-0@lo:101: 00010000:00010000:2.0:1789135753.933464:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135753.933485:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072490147/0x38eb79866bf95da2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95d9b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135753.933516:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072490147/0x38eb79866bf95da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135753.933527:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072490147/0x38eb79866bf95da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135753.933535:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072490147, rc 0) 00000100:00100000:2.0:1789135753.933589:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b5e8316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723260800:12345-0@lo:101: Request processed in 139us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135753.933595:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135753.933754:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044100d5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723260800:0@lo:101: 00010000:00010000:1.0:1789135753.933770:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135753.933778:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135753.933832:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fe15ad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723260928:0@lo:256: 00000100:00100000:1.0:1789135753.933866:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135753.933901:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a02678f9 going to sleep for 11 seconds 00000100:00100000:2.0:1789135753.935888:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723260928 00000100:00100000:2.0:1789135753.935901:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723260928 00000100:00100000:2.0:1789135753.935953:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135753.935960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab70563d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723260928:12345-0@lo:256: 20000000:01000000:2.0:1789135753.935985:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135753.936007:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135753.936011:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789135753.937678:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab70563d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723260928:12345-0@lo:256: Request processed in 1713us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135753.937691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135753.938376:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fe15ad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723260928:0@lo:256: 10000000:01000000:1.0:1789135753.938443:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135753.938452:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135753.938462:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: 000000008615fa7e/0x38eb79866bf95d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135754.066777:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135755.084936:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135756.109144:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135757.005618:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135757.005644:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021351f7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723261184:0@lo:400: 00000100:00100000:3.0:1789135757.005741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135757.005871:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135757.005880:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723261056:0@lo:400: 00000100:00100000:0.0:1789135757.005914:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135757.005961:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261184 00000100:00100000:0.0:1789135757.005968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261184 00000100:00100000:0.0:1789135757.006030:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135757.006038:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061b4f215 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723261184:12345-0@lo:400: 00000100:00100000:0.0:1789135757.006090:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061b4f215 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723261184:12345-0@lo:400: Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135757.006097:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789135757.006131:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000021351f7a x1876044723261184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135757.006144:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021351f7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723261184:0@lo:400: 00000100:00100000:3.0:1789135757.006695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261056 00000100:00100000:3.0:1789135757.006728:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261056 00000100:00100000:3.0:1789135757.006766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135757.006773:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002820c51e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3313:x1876044723261056:12345-0@lo:400: 00000100:00100000:3.0:1789135757.006824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002820c51e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3313:x1876044723261056:12345-0@lo:400: Request processed in 52us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.006830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135757.007290:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e3219b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723261056:0@lo:400: 00010000:00010000:1.0:1789135757.132974:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789135757.592021:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff08eb4620 20000000:00000080:0.0:1789135757.592045:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba072515800 uarg=0000000000000000 20000000:01000000:0.0:1789135757.592081:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789135757.592090:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789135757.592094:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789135757.592325:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789135757.592336:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789135757.602592:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135757.602891:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789135757.602960:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789135757.603008:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789135757.603029:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135757.603052:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.603073:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.603081:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.603123:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.603140:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135757.603156:0:6331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095465be3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1876044723261312:0@lo:104: 00000100:00100000:0.0:1789135757.603225:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135757.603301:0:6331:0:(client.c:2715:ptlrpc_set_wait()) set 000000009aa987e0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135757.609550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261312 00000100:00100000:2.0:1789135757.609566:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261312 00000100:00100000:2.0:1789135757.609631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135757.609639:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097372cbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:6331:x1876044723261312:12345-0@lo:104: 00010000:00010000:2.0:1789135757.609657:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609814:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135757.609820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097372cbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:6331:x1876044723261312:12345-0@lo:104: Request processed in 182us (6595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.609827:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789135757.609862:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135757.609868:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609874:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001aa1a765 already unused, calling callback (0000000004c401e6) 10000000:00010000:2.0:1789135757.609877:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609883:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135757.609889:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.609894:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135757.609931:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609955:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135757.609973:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609978:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: 000000001aa1a765/0x38eb79866bf95d63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.609998:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.609999:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.610000:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135757.610022:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a68a91d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723261440:0@lo:103: 00000100:00100000:2.0:1789135757.610062:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.610138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261440 00000100:00100000:2.0:1789135757.610142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261440 00010000:00010000:2.0:1789135757.610160:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 12 pid: 5842 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.610183:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135757.610190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014fdde84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3312:x1876044723261440:12345-0@lo:103: 00010000:00010000:2.0:1789135757.610201:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135757.610204:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 12 pid: 5842 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610213:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 12 pid: 5842 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610229:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610247:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610261:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610267:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610272:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610277:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610281:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a61e73e1 already unused, calling callback (00000000c43687a6) 00010000:00010000:2.0:1789135757.610284:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610301:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610308:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.610318:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135757.610345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014fdde84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3312:x1876044723261440:12345-0@lo:103: Request processed in 157us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.610351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135757.610383:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a68a91d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723261440:0@lo:103: 00010000:00010000:1.0:1789135757.610629:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e74e1380/0x38eb79866bf95d6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95d63 expref: 11 pid: 5842 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.610642:0:6331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095465be3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1876044723261312:0@lo:104: 00010000:00010000:1.0:1789135757.610655:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.610663:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.610668:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.610672:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a61e73e1/0x38eb79866bf95da9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135758.157240:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135759.187281:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135760.211115:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135761.243262:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135762.125236:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000931e9a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723261696:0@lo:400: 00000100:00100000:0.0:1789135762.125400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135762.125464:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135762.125470:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000512bb47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723261568:0@lo:400: 00000100:00100000:0.0:1789135762.125501:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135762.125536:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261696 00000100:00100000:0.0:1789135762.125544:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261696 00000100:00100000:0.0:1789135762.125607:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135762.125615:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a0eef66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723261696:12345-0@lo:400: 00000100:00100000:0.0:1789135762.125667:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a0eef66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723261696:12345-0@lo:400: Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135762.125675:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135762.125720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261568 00000100:00100000:0.0:1789135762.125724:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261568 00000100:00100000:0.0:1789135762.125749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135762.125754:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b7c7e93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:3314:x1876044723261568:12345-0@lo:400: 00000100:00100000:0.0:1789135762.125794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b7c7e93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:3314:x1876044723261568:12345-0@lo:400: Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135762.125800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135762.125854:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000512bb47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723261568:0@lo:400: 00010000:00080000:0.0:1789135762.125867:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000931e9a7b x1876044723261696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135762.125878:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000931e9a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723261696:0@lo:400: 00010000:00010000:1.0:1789135762.256140:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135763.279734:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789135764.173612:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135764.173620:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 1 10000000:01000000:0.0:1789135764.173625:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135764.173672:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: 0000000055896b1e/0x38eb79866bf95db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135764.173724:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: 0000000055896b1e/0x38eb79866bf95db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135764.173737:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: 0000000055896b1e/0x38eb79866bf95db0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135764.173761:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000512bb47b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723261824:0@lo:101: 00000100:00100000:0.0:1789135764.173864:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135764.173924:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab6b4d48 going to sleep for 11 seconds 00000100:00100000:2.0:1789135764.174636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261824 00000100:00100000:2.0:1789135764.174646:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261824 00000100:00100000:2.0:1789135764.174799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789135764.174811:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa245ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:5846:x1876044723261824:12345-0@lo:101: 00010000:00010000:2.0:1789135764.174828:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135764.174844:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aa1a765/0x38eb79866bf95db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95db0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135764.174886:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aa1a765/0x38eb79866bf95db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135764.174897:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aa1a765/0x38eb79866bf95db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135764.174906:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aa1a765, rc 0) 00000100:00100000:2.0:1789135764.174988:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa245ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723261824:12345-0@lo:101: Request processed in 180us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135764.175045:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000512bb47b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723261824:0@lo:101: 00010000:00010000:3.0:1789135764.175058:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: 0000000055896b1e/0x38eb79866bf95db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135764.175077:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: 0000000055896b1e/0x38eb79866bf95db0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135764.175146:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000612d832f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723261952:0@lo:501: 00000100:00100000:3.0:1789135764.175190:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135764.175217:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000daa7073e going to sleep for 11 seconds 00000100:00100000:3.0:1789135764.175230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723261952 00000100:00100000:3.0:1789135764.175234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723261952 00000100:00100000:2.0:1789135764.181412:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135764.188652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789135764.188667:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b5240ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723261952:12345-0@lo:501: 00000100:00100000:3.0:1789135764.189067:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b5240ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723261952:12345-0@lo:501: Request processed in 404us (13876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135764.189076:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789135764.189125:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000612d832f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723261952:0@lo:501: 00000100:00100000:3.0:1789135764.189184:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000612d832f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723262080:0@lo:503: 00000100:00100000:3.0:1789135764.189231:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135764.203109:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000daa7073e going to sleep for 11 seconds 00000100:00100000:1.0:1789135764.210620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262080 00000100:00100000:1.0:1789135764.210637:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262080 00000100:00100000:1.0:1789135764.210720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135764.210730:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371ff929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723262080:12345-0@lo:503: 00000100:00100000:1.0:1789135764.210977:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371ff929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723262080:12345-0@lo:503: Request processed in 248us (21745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.210985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135764.212642:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000612d832f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723262080:0@lo:503: 00000100:00100000:2.0:1789135764.217665:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6668:1876044723262208:0@lo:502: 00000100:00100000:1.0:1789135764.218563:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135764.218626:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set 000000006703cfa1 going to sleep for 11 seconds 00000100:00100000:2.0:1789135764.218853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262208 00000100:00100000:2.0:1789135764.218861:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262208 00000100:00100000:2.0:1789135764.218913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135764.218921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f3925e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6668:x1876044723262208:12345-0@lo:502: 00000100:00100000:2.0:1789135764.219140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f3925e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6668:x1876044723262208:12345-0@lo:502: Request processed in 220us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.219149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135764.219253:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b9407fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6668:1876044723262208:0@lo:502: 00000020:01000000:1.0:1789135764.219312:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135764.219324:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135764.219326:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135764.219335:0:6668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba04857c800 00000020:00000080:1.0:1789135764.219338:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135764.219385:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6668:1876044723262336:0@lo:502: 00000100:00100000:1.0:1789135764.219423:0:6668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135764.219451:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135764.219610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262336 00000100:00100000:2.0:1789135764.219616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262336 00000100:00100000:2.0:1789135764.219654:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789135764.219662:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6668:x1876044723262336:12345-0@lo:502: 00000100:00100000:2.0:1789135764.219816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6668:x1876044723262336:12345-0@lo:502: Request processed in 155us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.219823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135764.220813:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6668:1876044723262336:0@lo:502: 00000020:01000000:1.0:1789135764.220842:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135764.220850:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135764.220852:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135764.220857:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789135764.221118:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789135764.221136:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135764.221146:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135764.221157:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135764.300892:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789135765.286377:0:6695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789135765.286381:0:6695:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789135765.286522:0:6695:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba0504e6000 00000020:01000004:2.0:1789135765.286538:0:6695:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789135765.286549:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789135765.286569:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ba07433ced8) 00000020:00000080:2.0:1789135765.286583:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1789135765.329812:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789135765.332019:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789135765.332289:0:6695:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789135765.365131:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789135765.369816:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789135765.369848:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789135765.369902:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789135765.369926:0:6695:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789135765.370332:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789135765.370343:0:6695:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789135765.370353:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x38eb79866bf95dc5 00000020:01000004:2.0:1789135765.370369:0:6695:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789135765.370390:0:6695:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789135765.370394:0:6695:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789135765.370400:0:6695:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789135765.370404:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789135765.370415:0:6695:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ba07433b490) 00000020:00000080:2.0:1789135765.370424:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789135765.371595:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135765.371989:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789135765.372002:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789135765.376846:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135765.376866:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789135765.387315:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789135765.387333:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789135765.404364:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135765.404574:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789135765.404581:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789135765.407627:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789135765.407641:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789135765.462490:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135765.462928:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789135765.462934:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789135765.466357:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789135765.466374:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789135765.468615:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789135765.468628:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789135765.474949:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135765.475282:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789135765.475288:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789135765.476318:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789135765.476326:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789135765.620959:0:6695:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135765.621168:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135765.621175:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789135765.624527:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135765.624539:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789135765.625111:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789135765.625152:0:6695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789135765.625159:0:6695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789135765.666201:0:6695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789135765.666239:0:6695:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.141@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789135765.666243:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789135765.666245:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789135765.666246:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135765.666248:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135765.666249:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135765.666250:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135765.666485:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135765.666488:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135765.666490:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135765.666492:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135765.666493:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135765.666504:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789135765.666506:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135765.666508:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789135765.666509:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135765.666509:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135765.666510:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135765.666511:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135765.666512:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135765.666513:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135765.666514:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135765.666515:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135765.666516:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135765.666547:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789135765.666566:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723262464:0@lo:253: 00000100:00100000:0.0:1789135765.666656:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.666804:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.672695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262464 00000100:00100000:1.0:1789135765.672744:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262464 00000100:00100000:1.0:1789135765.672820:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135765.672832:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723262464:12345-0@lo:253: 20000000:01000000:1.0:1789135765.672878:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789135765.672882:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789135765.672888:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789135765.672893:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789135765.675001:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135765.678776:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789135765.678810:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789135765.678892:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789135765.678902:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789135765.678934:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789135765.678990:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789135765.680525:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789135765.680558:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.141@tcp 20000000:01000000:2.0:1789135765.680561:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.141@tcp (null) (null) (null) 00000040:00080000:2.0:1789135765.680607:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789135765.680617:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789135765.680667:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789135765.680675:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.141@tcp (null) (null) 00000040:00080000:2.0:1789135765.680757:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789135765.680768:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789135765.680800:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789135765.680872:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789135765.681641:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789135765.681659:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.141@tcp 20000000:01000000:2.0:1789135765.681661:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.141@tcp (null) (null) (null) 00000040:00080000:2.0:1789135765.681694:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789135765.681730:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789135765.681779:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789135765.681788:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.141@tcp (null) (null) 00000040:00080000:2.0:1789135765.681832:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789135765.681842:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789135765.681873:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789135765.681906:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789135765.681921:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789135765.681924:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789135765.681927:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789135765.681939:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789135765.681942:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789135765.681972:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789135765.681974:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135765.690428:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135765.690531:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135765.690592:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789135765.695552:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789135765.695608:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789135765.695690:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789135765.696672:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789135765.696676:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135765.697387:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135765.697465:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135765.697513:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789135765.697963:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789135765.698008:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789135765.698045:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789135765.698060:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789135765.698062:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789135765.698560:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789135765.698793:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789135765.698832:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789135765.698894:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789135765.698913:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789135765.698915:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789135765.698925:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789135765.698945:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.698964:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.698973:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.698980:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699001:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699045:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699062:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 12 pid: 5842 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135765.699078:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723262592:0@lo:104: 00000100:00100000:1.0:1789135765.699158:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135765.699225:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699233:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 12 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135765.699243:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723262720:0@lo:104: 00000100:00100000:1.0:1789135765.699278:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135765.699308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262592 00000100:00100000:1.0:1789135765.699314:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262592 00000100:00100000:1.0:1789135765.699507:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262720 00000100:00100000:1.0:1789135765.699512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262720 00000100:00100000:1.0:1789135765.699527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135765.699535:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:5843:x1876044723262592:12345-0@lo:104: 00010000:00010000:1.0:1789135765.699549:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699595:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135765.699606:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:5843:x1876044723262592:12345-0@lo:104: Request processed in 71us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.699613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135765.699629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135765.699635:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5843:x1876044723262720:12345-0@lo:104: 00010000:00010000:1.0:1789135765.699642:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699675:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135765.699680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5843:x1876044723262720:12345-0@lo:104: Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.699685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789135765.699726:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135765.699732:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699739:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135765.699743:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699751:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135765.699757:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135765.699762:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135765.699792:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699807:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135765.699825:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699832:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d78 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699845:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135765.699849:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699854:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135765.699857:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699863:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135765.699869:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135765.699874:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135765.699888:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699893:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135765.699898:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699904:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8e00/0x38eb79866bf95d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95d08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.699921:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135765.699923:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135765.699925:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135765.699948:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723262848:0@lo:103: 00000100:00100000:1.0:1789135765.699977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135765.700001:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135765.700007:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723262976:0@lo:103: 00000100:00100000:1.0:1789135765.700026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135765.700057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262848 00000100:00100000:1.0:1789135765.700061:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262848 00010000:00010000:1.0:1789135765.700079:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 13 pid: 5842 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135765.700096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723262976 00000100:00100000:1.0:1789135765.700099:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723262976 00010000:00010000:1.0:1789135765.700110:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 14 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135765.700122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135765.700128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3311:x1876044723262848:12345-0@lo:103: 00010000:00010000:1.0:1789135765.700151:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135765.700156:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 14 pid: 5842 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.700165:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 14 pid: 5842 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.700181:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135765.700214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3311:x1876044723262848:12345-0@lo:103: Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.700221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135765.700234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135765.700241:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3311:x1876044723262976:12345-0@lo:103: 00010000:00010000:1.0:1789135765.700248:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135765.700431:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700441:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.700450:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723263104:0@lo:104: 00000100:00100000:0.0:1789135765.700479:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.700498:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041eb40 going to sleep for 11 seconds 00010000:00010000:0.0:1789135765.700518:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030000/0x38eb79866bf95d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95d71 expref: 13 pid: 5842 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.700540:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723262592:0@lo:104: 00000100:00100000:0.0:1789135765.700550:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723262720:0@lo:104: 00000100:00100000:0.0:1789135765.700575:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723262848:0@lo:103: 00000100:00100000:0.0:1789135765.700603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263104 00000100:00100000:0.0:1789135765.700607:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263104 00000100:00100000:0.0:1789135765.700626:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135765.700631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5843:x1876044723263104:12345-0@lo:104: 00010000:00010000:0.0:1789135765.700640:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700678:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135765.700683:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5843:x1876044723263104:12345-0@lo:104: Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.700689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135765.700756:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1876044723263104:0@lo:104: 00010000:00010000:0.0:1789135765.700778:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700800:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135765.700804:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700810:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9800 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135765.700814:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700831:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135765.700838:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135765.700843:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135765.700863:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700870:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135765.700882:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700889:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95cec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.700901:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135765.700903:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135765.700905:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135765.700910:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135765.700920:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723263232:0@lo:103: 00000100:00100000:0.0:1789135765.700945:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.700971:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789135765.700978:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789135765.701692:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135765.701731:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789135765.701742:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263232 00000100:00100000:3.0:1789135765.701746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263232 00010000:00010000:3.0:1789135765.701766:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135765.701783:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789135765.701790:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135765.701796:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3314:x1876044723263232:12345-0@lo:103: 00010000:00010000:3.0:1789135765.701820:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135765.701826:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.701835:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.701849:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf95cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95ce5 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.701862:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135765.701905:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3314:x1876044723263232:12345-0@lo:103: Request processed in 109us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135765.701912:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135765.702065:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723263232:0@lo:103: 00010000:00010000:1.0:1789135765.702141:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702154:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 11 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702165:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95d01 expref: 11 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702176:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702184:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702199:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702205:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702211:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702217:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702229:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135765.702234:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.702241:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.713631:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.713652:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135765.713661:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1789135765.729017:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.729039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95dd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.729069:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135765.730097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:3311:x1876044723262976:12345-0@lo:103: Request processed in 29850us (30063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.730110:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135765.730516:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723262976:0@lo:103: 00000100:00100000:0.0:1789135765.800855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:6695:x1876044723262464:12345-0@lo:253: Request processed in 128016us (134189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.800884:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135765.801126:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723262464:0@lo:253: 10000000:01000000:2.0:1789135765.801154:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789135765.801166:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135765.801167:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135765.801169:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135765.801170:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789135765.801171:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135765.801172:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135765.801174:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135765.801176:0:6695:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789135765.801177:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135765.801178:0:6695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789135765.801196:0:6695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba0504e6000 from lustre-OST0000 10000000:01000000:2.0:1789135765.801221:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789135765.801224:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789135765.801230:0:6695:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ba0592cced8 local copy 10000000:01000000:2.0:1789135765.801234:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789135765.801281:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.801293:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.801303:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135765.801319:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263360:0@lo:101: 00000100:00100000:2.0:1789135765.801365:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.801425:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.801632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263360 00000100:00100000:1.0:1789135765.801638:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263360 00000100:00100000:1.0:1789135765.801684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135765.801693:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:6695:x1876044723263360:12345-0@lo:101: 00010000:00010000:1.0:1789135765.801734:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135765.801749:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95dda expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.801771:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95dda expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.801781:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95dda expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.801801:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8200, rc 0) 00000100:00100000:1.0:1789135765.801832:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:6695:x1876044723263360:12345-0@lo:101: Request processed in 141us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.801839:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135765.801914:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263360:0@lo:101: 00010000:00010000:0.0:1789135765.801927:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.801937:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.802071:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263488:0@lo:501: 00000100:00100000:0.0:1789135765.802099:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.802128:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135765.802191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263488 00000100:00100000:3.0:1789135765.802202:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263488 00000100:00100000:3.0:1789135765.802235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789135765.802241:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:6695:x1876044723263488:12345-0@lo:501: 00000100:00100000:3.0:1789135765.802473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:6695:x1876044723263488:12345-0@lo:501: Request processed in 232us (373us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135765.802482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135765.802601:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263488:0@lo:501: 10000000:01000000:0.0:1789135765.802614:0:6695:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789135765.802636:0:6695:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789135765.802642:0:6695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.802651:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.802658:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.802684:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789135765.802728:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba0504e6000 10000000:01000000:0.0:1789135765.802733:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789135765.802738:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ba0592cced8 10000000:01000000:0.0:1789135765.802746:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789135765.802750:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ba0592cced8 from 1 10000000:01000000:0.0:1789135765.802753:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789135765.802771:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.802778:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.802787:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.802799:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263616:0@lo:101: 00000100:00100000:0.0:1789135765.802825:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.802842:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.802971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263616 00000100:00100000:1.0:1789135765.802976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263616 00000100:00100000:1.0:1789135765.802998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135765.803004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+10:6695:x1876044723263616:12345-0@lo:101: 00010000:00010000:1.0:1789135765.803012:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135765.803023:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8e00/0x38eb79866bf95def lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95de8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803038:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8e00/0x38eb79866bf95def lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95de8 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803047:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec8e00/0x38eb79866bf95def lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95de8 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803053:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8e00, rc 0) 00000100:00100000:1.0:1789135765.803090:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723263616:12345-0@lo:101: Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.803096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789135765.803174:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263616:0@lo:101: 00010000:00010000:0.0:1789135765.803185:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.803194:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135765.803208:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789135765.803225:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.803234:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135765.803240:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789135765.803258:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789135765.803262:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789135765.803264:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135765.803278:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.803284:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.803291:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.803302:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263744:0@lo:101: 00000100:00100000:0.0:1789135765.803549:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.803565:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.803625:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263744 00000100:00100000:1.0:1789135765.803630:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263744 00000100:00100000:1.0:1789135765.803649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789135765.803655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723263744:12345-0@lo:101: 00010000:00010000:1.0:1789135765.803663:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135765.803678:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95df6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803692:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803731:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135765.803739:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9a00, rc 0) 00000100:00100000:1.0:1789135765.803767:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723263744:12345-0@lo:101: Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.803773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789135765.803850:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135765.803859:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.803868:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135765.803872:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.803882:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135765.803888:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135765.803894:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789135765.803913:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.803920:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135765.803947:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.803953:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf95dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95de1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.803979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135765.803981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135765.803983:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135765.803991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135765.804002:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723263872:0@lo:103: 00000100:00100000:3.0:1789135765.804031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.804061:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723263872 00000100:00100000:3.0:1789135765.804065:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723263872 00000100:00100000:3.0:1789135765.804093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135765.804100:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3313:x1876044723263872:12345-0@lo:103: 00010000:00010000:3.0:1789135765.804109:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135765.804120:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95dda expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.804141:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135765.804167:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:3313:x1876044723263872:12345-0@lo:103: Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135765.804174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135765.804202:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723263872:0@lo:103: 00000100:00100000:0.0:1789135765.804284:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723263744:0@lo:101: 00010000:00010000:0.0:1789135765.804297:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.804306:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.804407:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264000:0@lo:501: 00000100:00100000:0.0:1789135765.804434:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.804455:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135765.804941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264000 00000100:00100000:3.0:1789135765.804946:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264000 00000100:00100000:3.0:1789135765.804975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135765.804982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264000:12345-0@lo:501: 00000100:00100000:3.0:1789135765.805242:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264000:12345-0@lo:501: Request processed in 259us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135765.805315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135765.805618:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264000:0@lo:501: 00000100:00100000:0.0:1789135765.805655:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264128:0@lo:503: 00000100:00100000:0.0:1789135765.805696:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.805755:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135765.805770:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264128 00000100:00100000:0.0:1789135765.805774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264128 00000100:00100000:0.0:1789135765.805807:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135765.805813:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264128:12345-0@lo:503: 00000100:00100000:0.0:1789135765.805965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264128:12345-0@lo:503: Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.805972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789135765.806091:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264128:0@lo:503: 00000040:00080000:1.0:1789135765.806421:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135765.806477:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264256:0@lo:502: 00000100:00100000:1.0:1789135765.806511:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135765.806538:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135765.806742:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264256 00000100:00100000:0.0:1789135765.806747:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264256 00000100:00100000:0.0:1789135765.806779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135765.806786:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264256:12345-0@lo:502: 00000100:00100000:0.0:1789135765.806926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264256:12345-0@lo:502: Request processed in 139us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.806933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135765.807119:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264256:0@lo:502: 00000040:00080000:1.0:1789135765.807651:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789135765.807858:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789135765.807897:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789135765.807945:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789135765.807985:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789135765.808023:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789135765.808054:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264384:0@lo:502: 00000100:00100000:1.0:1789135765.808108:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135765.808156:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135765.809445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264384 00000100:00100000:0.0:1789135765.809456:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264384 00000100:00100000:0.0:1789135765.809518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135765.809528:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264384:12345-0@lo:502: 00000100:00100000:0.0:1789135765.809786:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264384:12345-0@lo:502: Request processed in 258us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.809794:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789135765.810375:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264384:0@lo:502: 00000040:00080000:1.0:1789135765.810531:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789135765.810546:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789135765.813566:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789135765.813579:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789135765.813586:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135765.813589:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789135765.813594:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789135765.813608:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ba0503b3490) 00000020:00000080:1.0:1789135765.813630:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789135765.813635:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789135765.813745:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba0504e6000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789135765.813753:0:6714:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789135765.813759:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x38eb79866bf95e0b 00010000:00010000:1.0:1789135765.823009:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789135765.823597:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789135765.827548:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789135765.827887:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789135765.836493:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789135765.837492:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789135765.839756:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789135765.839769:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135765.839781:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135765.839784:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789135765.839791:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135765.839796:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135765.839797:0:6714:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789135765.839800:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789135765.839802:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789135765.839844:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135765.839847:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135765.839849:0:6714:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789135765.839852:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789135765.843583:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789135765.843628:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789135765.843657:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.843671:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135765.843679:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba0504e6000 from 1 10000000:01000000:3.0:1789135765.843682:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135765.843742:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.843752:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.843766:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135765.843792:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264512:0@lo:101: 00000100:00100000:3.0:1789135765.843859:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.843942:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba05047ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.847015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264512 00000100:00100000:2.0:1789135765.847027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264512 00000100:00100000:2.0:1789135765.847080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789135765.847090:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:6695:x1876044723264512:12345-0@lo:101: 00010000:00010000:2.0:1789135765.847111:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135765.847143:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.847182:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.847194:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.847203:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0fc00, rc 0) 00000100:00100000:2.0:1789135765.847432:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264512:12345-0@lo:101: Request processed in 343us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.847439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789135765.847605:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264512:0@lo:101: 00010000:00010000:2.0:1789135765.847625:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.847635:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135765.847800:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264640:0@lo:501: 00000100:00100000:2.0:1789135765.847835:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.847863:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.847881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264640 00000100:00100000:2.0:1789135765.847885:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264640 00000100:00100000:2.0:1789135765.847906:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135765.847913:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264640:12345-0@lo:501: 00000100:00100000:2.0:1789135765.848123:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264640:12345-0@lo:501: Request processed in 209us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.848320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135765.848364:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264640:0@lo:501: 00000100:00100000:2.0:1789135765.848393:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264768:0@lo:503: 00000100:00100000:2.0:1789135765.848429:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.848452:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.848465:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264768 00000100:00100000:2.0:1789135765.848469:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264768 00000100:00100000:2.0:1789135765.848490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135765.848496:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264768:12345-0@lo:503: 00000100:00100000:2.0:1789135765.848725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264768:12345-0@lo:503: Request processed in 203us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.848732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135765.848779:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264768:0@lo:503: 00000040:00080000:2.0:1789135765.849067:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135765.849777:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264896:0@lo:502: 00000100:00100000:2.0:1789135765.849837:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.849911:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135765.853944:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723264896 00000100:00100000:0.0:1789135765.853957:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723264896 00000100:00100000:0.0:1789135765.854059:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135765.854072:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264896:12345-0@lo:502: 00000100:00100000:0.0:1789135765.854555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723264896:12345-0@lo:502: Request processed in 484us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.854564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789135765.854673:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723264896:0@lo:502: 00000040:00080000:3.0:1789135765.855016:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789135765.855069:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789135765.855108:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265024:0@lo:502: 00000100:00100000:3.0:1789135765.855169:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.855557:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba05047ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.855636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265024 00000100:00100000:2.0:1789135765.855642:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265024 00000100:00100000:2.0:1789135765.855673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789135765.855681:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723265024:12345-0@lo:502: 00000100:00100000:2.0:1789135765.855857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723265024:12345-0@lo:502: Request processed in 175us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.855864:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135765.855965:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265024:0@lo:502: 00000040:00080000:3.0:1789135765.856082:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789135765.856093:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789135765.856655:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135765.856665:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135765.856667:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789135765.856673:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba0504e6000 00000020:00000080:3.0:1789135765.856676:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135765.856692:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135765.856695:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135765.856696:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789135765.856761:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789135765.857068:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789135765.857091:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135765.857113:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.857237:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135765.857357:0:6695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789135765.857361:0:6695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba0504e6000 10000000:01000000:2.0:1789135765.857364:0:6695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba0504e6000 10000000:01000000:2.0:1789135765.857369:0:6695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135765.857376:0:6695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba0504e6000 from 1 10000000:01000000:2.0:1789135765.857379:0:6695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135765.857424:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.857434:0:6695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.857445:0:6695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135765.857470:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265152:0@lo:101: 00000100:00100000:2.0:1789135765.857531:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.857604:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135765.857692:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265152 00000100:00100000:3.0:1789135765.859523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265152 00000100:00100000:3.0:1789135765.859593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135765.859602:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723265152:12345-0@lo:101: 00010000:00010000:3.0:1789135765.859619:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135765.859636:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e20 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.859662:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.859672:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.859681:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cdc00, rc 0) 00000100:00100000:3.0:1789135765.859852:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265152:12345-0@lo:101: Request processed in 250us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135765.859859:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789135765.859958:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265152:0@lo:101: 00010000:00010000:2.0:1789135765.859977:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.859986:0:6695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135765.860115:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265280:0@lo:501: 00000100:00100000:2.0:1789135765.860166:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.860234:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.867178:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265280 00000100:00100000:1.0:1789135765.867192:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265280 00000100:00100000:0.0:1789135765.868231:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789135765.868243:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265280:12345-0@lo:501: 00000100:00100000:0.0:1789135765.868969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265280:12345-0@lo:501: Request processed in 726us (8800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.868979:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135765.871862:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265280:0@lo:501: 00000100:00100000:2.0:1789135765.871930:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265408:0@lo:503: 00000100:00100000:2.0:1789135765.872012:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.872067:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135765.872174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265408 00000100:00100000:0.0:1789135765.872183:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265408 00000100:00100000:0.0:1789135765.872260:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789135765.872273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265408:12345-0@lo:503: 00000100:00100000:0.0:1789135765.872768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265408:12345-0@lo:503: Request processed in 498us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.872786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135765.873488:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265408:0@lo:503: 00000040:00080000:2.0:1789135765.873829:0:6695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135765.873894:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265536:0@lo:502: 00000100:00100000:2.0:1789135765.873940:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.873975:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.874056:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265536 00000100:00100000:1.0:1789135765.874061:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265536 00000100:00100000:1.0:1789135765.874093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789135765.874101:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265536:12345-0@lo:502: 00000100:00100000:1.0:1789135765.874319:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265536:12345-0@lo:502: Request processed in 217us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.874326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135765.874602:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265536:0@lo:502: 00000040:00080000:3.0:1789135765.874918:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789135765.874970:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789135765.875005:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789135765.875053:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789135765.875091:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789135765.875463:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789135765.875506:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789135765.875536:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789135765.875581:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789135765.875616:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789135765.875649:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789135765.875719:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789135765.875759:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789135765.875790:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789135765.875834:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789135765.875873:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789135765.875906:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789135765.875951:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789135765.875988:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789135765.876023:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789135765.876093:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789135765.877553:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789135765.877643:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789135765.877742:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789135765.877780:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789135765.877812:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789135765.877858:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789135765.877892:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789135765.877951:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265664:0@lo:502: 00000100:00100000:3.0:1789135765.878039:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.878084:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06a907300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135765.878913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265664 00000100:00100000:1.0:1789135765.878923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265664 00000100:00100000:1.0:1789135765.878985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789135765.878995:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265664:12345-0@lo:502: 00000100:00100000:1.0:1789135765.879266:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723265664:12345-0@lo:502: Request processed in 272us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135765.879283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135765.879357:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723265664:0@lo:502: 00000040:00080000:3.0:1789135765.879649:0:6695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789135765.879661:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789135765.880242:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789135765.880269:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ba0503b0000) 00000020:00000080:1.0:1789135765.880289:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789135765.880742:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba0504e6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789135765.880748:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba0504e6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789135765.880751:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba0504e6000 3 00010000:00080000:1.0:1789135765.880793:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b9f45963000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.141@tcp at head 00010000:00010000:2.0:1789135765.897051:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789135765.897542:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789135765.897582:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789135765.897594:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x38eb79866bf95e35 00000100:00080000:2.0:1789135765.897604:0:6719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135765.897610:0:6719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b9f45963000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789135765.897646:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c39a1c0 x1876044723265792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135765.897741:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723265792:0@lo:38: 00000100:00100000:3.0:1789135765.897811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789135765.900938:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135765.901151:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265792 00000100:00100000:0.0:1789135765.901162:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265792 00000100:00100000:0.0:1789135765.901221:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135765.901230:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723265792:12345-0@lo:38: 00010000:00080000:0.0:1789135765.901260:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1789135765.901297:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x38eb79866bf95e3c 00000004:00100000:0.0:1789135765.901314:0:5852:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135765.901347:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8b9f456a6000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789135765.902765:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1789135765.903036:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876044723265792:12345-0@lo:38: Request processed in 1802us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.903049:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135765.903314:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135765.903594:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723265920:0@lo:400: 00000100:00100000:1.0:1789135765.903668:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.904257:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723265920 00000100:00100000:0.0:1789135765.904266:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723265920 00000100:00100000:0.0:1789135765.904313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135765.904322:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723265920:12345-0@lo:400: 00000100:00100000:0.0:1789135765.904600:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723265920:12345-0@lo:400: Request processed in 278us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.904608:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789135765.904697:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba05c3e1680 x1876044723265920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135765.904741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723265920:0@lo:400: 00010000:00080000:3.0:1789135765.918543:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba05c39a1c0 x1876044723265792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135765.918563:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135765.918576:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789135765.918590:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789135765.918597:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789135765.918602:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f45963000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789135765.918611:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723265792:0@lo:38: 00000020:01000000:3.0:1789135765.918688:0:6695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789135765.918769:0:6695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135765.918788:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135765.918798:0:6695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135765.918869:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135765.918872:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135765.918873:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135765.918874:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135765.918875:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135765.918877:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135765.918879:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135765.918880:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135765.918888:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135765.918890:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135765.918891:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135765.918895:0:6695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789135765.918898:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135765.918899:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135765.918900:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135765.918900:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135765.918901:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135765.918902:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135765.918903:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135765.918904:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135765.918905:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135765.918906:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135765.918906:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135765.918936:0:6695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789135765.918955:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723266048:0@lo:253: 00000100:00100000:3.0:1789135765.919040:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.919083:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266048 00000100:00100000:3.0:1789135765.919090:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266048 00000100:00100000:2.0:1789135765.921574:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06a907300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.922502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135765.922521:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:6695:x1876044723266048:12345-0@lo:253: 20000000:01000000:2.0:1789135765.922582:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789135765.922596:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789135765.967275:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789135765.967296:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789135765.967355:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789135765.967361:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789135765.967384:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.967404:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.967413:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.967466:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.967481:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.967497:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e12c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723266176:0@lo:104: 00000100:00100000:0.0:1789135765.967567:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135765.967595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266176 00000100:00100000:2.0:1789135765.967603:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266176 00000100:00100000:0.0:1789135765.967609:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135765.967646:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135765.967656:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723266176:12345-0@lo:104: 00000100:00100000:0.0:1789135765.967663:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1789135765.967670:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.967670:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789135765.967752:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135765.967759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723266176:12345-0@lo:104: Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.967767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789135765.967854:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135765.967860:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.967867:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cca00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:2.0:1789135765.967870:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.967878:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135765.967885:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135765.967890:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135765.967926:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.967933:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135765.967949:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135765.967956:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cca00/0x38eb79866bf95d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95da2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135765.967959:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723266304:0@lo:103: 00010000:00010000:2.0:1789135765.967973:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135765.967975:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135765.967977:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135765.967997:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.968304:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266304 00000100:00100000:0.0:1789135765.968310:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266304 00010000:00010000:0.0:1789135765.968333:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 14 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.969149:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135765.969162:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba049180850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3312:x1876044723266304:12345-0@lo:103: 00010000:00010000:0.0:1789135765.969175:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135765.969182:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 14 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969194:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 14 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969215:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969223:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135765.969247:0:6713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887435s 00010000:00010000:0.0:1789135765.969252:0:6713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969260:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969267:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969274:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969280:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135765.969284:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969293:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969303:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.969314:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135765.969375:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba049180850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3312:x1876044723266304:12345-0@lo:103: Request processed in 217us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.969383:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135765.972170:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723266304:0@lo:103: 00010000:00010000:0.0:1789135765.972238:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95da2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95d9b expref: 13 pid: 5843 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135765.972272:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e12c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723266176:0@lo:104: 00010000:00010000:0.0:1789135765.972290:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.972300:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.972306:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135765.972312:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030600/0x38eb79866bf95e43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135765.982652:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:6695:x1876044723266048:12345-0@lo:253: Request processed in 60129us (63601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135765.982667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135765.982867:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:6695:1876044723266048:0@lo:253: 10000000:01000000:3.0:1789135765.983096:0:6695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789135765.983099:0:6695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135765.983101:0:6695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135765.983102:0:6695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135765.983104:0:6695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135765.983105:0:6695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135765.983106:0:6695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135765.983108:0:6695:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135765.983110:0:6695:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135765.983112:0:6695:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135765.983113:0:6695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135765.983115:0:6695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789135765.983216:0:6695:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789135765.991666:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135765.991860:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135765.992057:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135765.994311:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135765.994962:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135765.995182:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789135766.000112:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789135766.349995:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789135766.354945:0:6695:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789135766.354952:0:6695:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789135766.354988:0:6695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789135766.355048:0:6695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789135766.355065:0:6695:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789135766.355095:0:6695:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789135767.372966:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135768.406887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135769.423527:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135770.450425:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135771.346217:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723266688:0@lo:400: 00000100:00100000:3.0:1789135771.346307:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135771.346389:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266688 00000100:00100000:3.0:1789135771.346396:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266688 00000100:00100000:3.0:1789135771.346454:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135771.346464:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723266688:12345-0@lo:400: 00000100:00100000:3.0:1789135771.346518:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723266688:12345-0@lo:400: Request processed in 56us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135771.346526:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789135771.346550:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135771.346577:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c09b480 x1876044723266688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135771.346592:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723266688:0@lo:400: 00000100:00100000:1.0:1789135771.346751:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723266560:0@lo:400: 00000100:00100000:1.0:1789135771.346781:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135771.346808:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135771.346814:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723266432:0@lo:400: 00000100:00100000:1.0:1789135771.346842:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135771.346875:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266432 00000100:00100000:1.0:1789135771.346879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266432 00000100:00100000:1.0:1789135771.346903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135771.346910:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3314:x1876044723266432:12345-0@lo:400: 00000100:00100000:1.0:1789135771.346944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3314:x1876044723266432:12345-0@lo:400: Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135771.346958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135771.346994:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723266432:0@lo:400: 00000100:00100000:3.0:1789135771.347123:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266560 00000100:00100000:3.0:1789135771.347127:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266560 00000100:00100000:3.0:1789135771.347214:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135771.347222:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723266560:12345-0@lo:400: 00000100:00100000:3.0:1789135771.347267:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723266560:12345-0@lo:400: Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135771.347273:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789135771.347368:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c099680 x1876044723266560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135771.347379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723266560:0@lo:400: 00010000:00010000:3.0:1789135771.468918:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135772.497681:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135773.520120:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789135773.903263:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135773.903272:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba04857c800 from 21 10000000:01000000:2.0:1789135773.903278:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135773.903338:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.903358:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.903372:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135773.903399:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723266816:0@lo:101: 00000100:00100000:2.0:1789135773.903477:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135773.903546:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135773.903846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266816 00000100:00100000:1.0:1789135773.903855:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266816 00000100:00100000:1.0:1789135773.903911:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135773.903921:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723266816:12345-0@lo:101: 00010000:00010000:1.0:1789135773.903936:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135773.903949:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e4a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.903971:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.903999:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.904010:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9200, rc 0) 00000100:00100000:1.0:1789135773.904056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723266816:12345-0@lo:101: Request processed in 136us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.904063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135773.904236:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723266816:0@lo:101: 00010000:00010000:2.0:1789135773.904254:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.904264:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135773.904326:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723266944:0@lo:501: 00000100:00100000:2.0:1789135773.904352:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135773.904383:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.904723:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723266944 00000100:00100000:0.0:1789135773.904729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723266944 00000100:00100000:0.0:1789135773.904761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789135773.904771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723266944:12345-0@lo:501: 00000100:00100000:0.0:1789135773.905690:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723266944:12345-0@lo:501: Request processed in 914us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135773.905725:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789135773.905790:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723266944:0@lo:501: 00000100:00100000:0.0:1789135773.905847:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267072:0@lo:503: 00000100:00100000:0.0:1789135773.905901:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.905936:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.905953:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267072 00000100:00100000:0.0:1789135773.905958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267072 00000100:00100000:1.0:1789135773.909120:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789135773.909152:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723267072:12345-0@lo:503: 00000100:00100000:1.0:1789135773.909474:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723267072:12345-0@lo:503: Request processed in 338us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.909501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135773.914649:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267072:0@lo:503: 00000100:00100000:0.0:1789135773.915726:0:7023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7023:1876044723267200:0@lo:502: 00000100:00100000:0.0:1789135773.915816:0:7023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.915856:0:7023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135773.915927:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267200 00000100:00100000:1.0:1789135773.915937:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267200 00000100:00100000:1.0:1789135773.916006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135773.916017:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7023:x1876044723267200:12345-0@lo:502: 00000100:00100000:1.0:1789135773.916369:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7023:x1876044723267200:12345-0@lo:502: Request processed in 354us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.916377:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135773.916583:0:7023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7023:1876044723267200:0@lo:502: 00000100:00100000:0.0:1789135773.916648:0:7023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7023:1876044723267328:0@lo:502: 00000100:00100000:0.0:1789135773.916685:0:7023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.916744:0:7023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135773.918246:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267328 00000100:00100000:1.0:1789135773.918256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267328 00000100:00100000:1.0:1789135773.918299:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135773.918308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7023:x1876044723267328:12345-0@lo:502: 00000100:00100000:1.0:1789135773.918567:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7023:x1876044723267328:12345-0@lo:502: Request processed in 259us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.918574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789135773.918743:0:7023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7023:1876044723267328:0@lo:502: 00000040:00080000:2.0:1789135773.918775:0:7023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789135773.919568:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789135773.919593:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135773.919603:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.919614:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135773.919623:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789135773.919626:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba04857c800 from 4 10000000:01000000:1.0:1789135773.919628:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789135773.919658:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.919681:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.919691:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.919733:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267456:0@lo:101: 00000100:00100000:1.0:1789135773.919778:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135773.919816:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.920145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267456 00000100:00100000:0.0:1789135773.920152:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267456 00000100:00100000:0.0:1789135773.920199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135773.920208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723267456:12345-0@lo:101: 00010000:00010000:0.0:1789135773.920221:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135773.920237:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e58 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920259:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920269:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920278:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030200, rc 0) 00000100:00100000:0.0:1789135773.920320:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723267456:12345-0@lo:101: Request processed in 114us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135773.920327:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135773.920363:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267456:0@lo:101: 00010000:00010000:0.0:1789135773.920379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920387:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135773.920441:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267584:0@lo:256: 00000100:00100000:0.0:1789135773.920468:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.920487:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135773.920571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267584 00000100:00100000:2.0:1789135773.920575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267584 00000100:00100000:2.0:1789135773.920597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789135773.920602:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723267584:12345-0@lo:256: 20000000:01000000:2.0:1789135773.920615:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135773.920632:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135773.920634:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789135773.920696:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723267584:12345-0@lo:256: Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.920726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135773.920792:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267584:0@lo:256: 10000000:01000000:0.0:1789135773.920836:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789135773.920842:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920849:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135773.920856:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789135773.920858:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789135773.920861:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135773.920879:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920886:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.920900:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135773.920912:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267712:0@lo:101: 00000100:00100000:0.0:1789135773.920941:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.920967:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135773.932146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267712 00000100:00100000:2.0:1789135773.932166:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267712 00000100:00100000:2.0:1789135773.932230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135773.932241:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723267712:12345-0@lo:101: 00010000:00010000:2.0:1789135773.932262:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135773.932285:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e66 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.932320:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.932332:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.932343:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e800, rc 0) 00000100:00100000:2.0:1789135773.932461:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723267712:12345-0@lo:101: Request processed in 220us (11518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.932468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789135773.936067:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267712:0@lo:101: 00010000:00010000:0.0:1789135773.936111:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.936126:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135773.936219:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267840:0@lo:501: 00000100:00100000:0.0:1789135773.936295:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.936386:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135773.942305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267840 00000100:00100000:2.0:1789135773.942331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267840 00000100:00100000:2.0:1789135773.942467:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135773.942479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723267840:12345-0@lo:501: 00000100:00100000:2.0:1789135773.942883:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723267840:12345-0@lo:501: Request processed in 406us (6586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.942903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135773.948238:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267840:0@lo:501: 00000100:00100000:1.0:1789135773.948350:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267968:0@lo:503: 00000100:00100000:1.0:1789135773.949042:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135773.955116:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.957727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723267968 00000100:00100000:0.0:1789135773.957743:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723267968 00000100:00100000:0.0:1789135773.957830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789135773.957841:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723267968:12345-0@lo:503: 00000100:00100000:0.0:1789135773.958882:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723267968:12345-0@lo:503: Request processed in 1038us (9835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135773.958893:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789135773.958951:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723267968:0@lo:503: 00000100:00100000:2.0:1789135773.961126:0:7024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7024:1876044723268096:0@lo:502: 00000100:00100000:2.0:1789135773.961227:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135773.961319:0:7024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069df8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.966062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268096 00000100:00100000:0.0:1789135773.966093:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268096 00000100:00100000:1.0:1789135773.966187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135773.966197:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:7024:x1876044723268096:12345-0@lo:502: 00000100:00100000:1.0:1789135773.966768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:7024:x1876044723268096:12345-0@lo:502: Request processed in 570us (5539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.966777:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789135773.966819:0:7024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7024:1876044723268096:0@lo:502: 00000020:01000000:2.0:1789135773.966862:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135773.966871:0:7024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789135773.966880:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135773.966883:0:7024:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789135773.966889:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789135773.966893:0:7024:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.141@tcp to nid 0x20000c0a8cc8d (192.168.204.141@tcp) 00000020:01000000:2.0:1789135773.966921:0:7024:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789135773.966924:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135773.966943:0:7024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ba074338000) 00000020:00000080:2.0:1789135773.966965:0:7024:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789135773.966972:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789135773.967147:0:7024:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789135773.967153:0:7024:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789135773.967161:0:7024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95e7b 00010000:00080000:2.0:1789135773.967197:0:7024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b9f47248800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:2.0:1789135773.967434:0:7024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789135774.044750:0:7024:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789135774.044776:0:7024:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789135774.046763:0:7024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135774.048312:0:7024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135774.049324:0:7024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789135774.049514:0:7024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789135774.053927:0:7028:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135774.053937:0:7028:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789135774.059728:0:7024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789135774.059747:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789135774.059792:0:7024:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789135774.059817:0:7024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf95e82 00000100:00080000:0.0:1789135774.059830:0:7024:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135774.059837:0:7024:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b9f47248800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:0.0:1789135774.059876:0:7024:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c3e3c00 x1876044723268224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789135774.059904:0:7024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789135774.060015:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723268224:0@lo:8: 00000100:00100000:3.0:1789135774.060228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789135774.060472:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135774.060477:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135774.060480:0:7024:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789135774.060482:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135774.060486:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135774.060487:0:7024:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789135774.060490:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789135774.060492:0:7024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789135774.060521:0:7024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7024:1876044723268352:0@lo:502: 00000100:00100000:0.0:1789135774.060572:0:7024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135774.060594:0:7024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135774.060688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268352 00000100:00100000:0.0:1789135774.060696:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268352 00000100:00100000:0.0:1789135774.060769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135774.060779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:7024:x1876044723268352:12345-0@lo:502: 00000100:00100000:0.0:1789135774.061143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:7024:x1876044723268352:12345-0@lo:502: Request processed in 365us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.061305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135774.061548:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268224 00000100:00100000:2.0:1789135774.061554:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268224 00000100:00100000:2.0:1789135774.061579:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135774.061584:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1876044723268224:12345-0@lo:8: 00010000:00080000:2.0:1789135774.061608:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1789135774.061639:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf95e89 00000100:00100000:1.0:1789135774.061659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135774.061676:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723268608:0@lo:400: 00002000:00100000:2.0:1789135774.061687:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b9f4724e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789135774.061693:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789135774.061697:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789135774.061751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.061796:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268608 00000100:00100000:1.0:1789135774.061800:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268608 00000100:00100000:1.0:1789135774.061848:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135774.061857:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c2452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723268608:12345-0@lo:400: 00002000:00100000:2.0:1789135774.061859:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789135774.061917:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c2452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723268608:12345-0@lo:400: Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.061939:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789135774.061966:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135774.062010:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e2940 x1876044723268608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.062024:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723268608:0@lo:400: 00002000:00080000:2.0:1789135774.062038:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135774.062069:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f47248000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135774.062102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135774.062114:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723268480:0@lo:400: 00000100:00100000:0.0:1789135774.062144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135774.062193:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268480 00000100:00100000:0.0:1789135774.062198:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268480 00000100:00100000:2.0:1789135774.062413:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876044723268224:12345-0@lo:8: Request processed in 826us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.062420:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135774.062446:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135774.062457:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723268480:12345-0@lo:400: 00000100:00100000:0.0:1789135774.062499:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723268480:12345-0@lo:400: Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.062506:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789135774.062654:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e3c00 x1876044723268224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.062664:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789135774.062671:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789135774.062679:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789135774.062685:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789135774.062688:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f47248800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789135774.062958:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789135774.062967:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723268224:0@lo:8: 00000004:00080000:1.0:1789135774.063004:0:7028:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789135774.063124:0:7028:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 247937423084ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789135774.065085:0:7024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7024:1876044723268352:0@lo:502: 00000020:01000000:1.0:1789135774.065139:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135774.065161:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135774.065164:0:7024:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135774.065170:0:7024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789135774.066646:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789135774.066677:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789135774.066690:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.066722:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135774.066733:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789135774.066736:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ba0592cced8 from 1 10000000:01000000:0.0:1789135774.066739:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135774.066775:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.066783:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.066807:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.066830:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723268736:0@lo:101: 00000100:00100000:0.0:1789135774.066902:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.067070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268736 00000100:00100000:1.0:1789135774.067077:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268736 00000100:00100000:1.0:1789135774.067120:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135774.067128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723268736:12345-0@lo:101: 00010000:00010000:1.0:1789135774.067286:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135774.067302:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95e90 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.067326:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.067337:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.067346:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9400, rc 0) 00000100:00100000:0.0:1789135774.067480:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117480 going to sleep for 11 seconds 00010000:00080000:0.0:1789135774.067517:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e1e00 x1876044723268480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135774.067530:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723268480:0@lo:400: 00000100:00100000:1.0:1789135774.067654:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723268736:12345-0@lo:101: Request processed in 526us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.067661:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135774.067823:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723268736:0@lo:101: 00010000:00010000:1.0:1789135774.067838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.067848:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135774.067901:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723268864:0@lo:501: 00000100:00100000:1.0:1789135774.067957:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.067991:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba05047ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135774.068008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268864 00000100:00100000:1.0:1789135774.068012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268864 00000100:00100000:1.0:1789135774.068035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135774.068042:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723268864:12345-0@lo:501: 00000100:00100000:1.0:1789135774.068255:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723268864:12345-0@lo:501: Request processed in 212us (297us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135774.068263:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135774.068293:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723268864:0@lo:501: 10000000:01000000:1.0:1789135774.068318:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789135774.068324:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.068332:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135774.149366:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789135774.204436:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723268992:0@lo:13: 00000100:00100000:2.0:1789135774.204532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.204673:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723268992 00000100:00100000:3.0:1789135774.204696:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723268992 00000004:00080000:0.0:1789135774.204754:0:7029:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789135774.204786:0:7029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269120:0@lo:7: 00000100:00100000:3.0:1789135774.204795:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135774.204810:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044723268992:12345-0@lo:13: 00000100:00100000:0.0:1789135774.204824:0:7029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135774.204845:0:7029:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117480 going to sleep for 11 seconds 00002000:00000024:3.0:1789135774.204865:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789135774.204872:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269120 00000100:00100000:0.0:1789135774.204877:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269120 00000100:00100000:0.0:1789135774.204908:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135774.204917:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7029:x1876044723269120:12345-0@lo:7: 00000100:00080000:1.0:1789135774.205520:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135774.213333:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723268992:12345-0@lo:13: Request processed in 8514us (8787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135774.213351:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789135774.220522:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e1e00 x1876044723268992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135774.220558:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723268992:0@lo:13: 00002000:00080000:0.0:1789135774.224764:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789135774.224774:0:6700:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789135774.224882:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7029:x1876044723269120:12345-0@lo:7: Request processed in 19961us (20053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.224895:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789135774.224950:0:7029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e30c0 x1876044723269120/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135774.224967:0:7029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269120:0@lo:7: 00000004:00080000:0.0:1789135774.225002:0:7029:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789135774.225042:0:7029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269248:0@lo:5: 00000100:00100000:0.0:1789135774.225079:0:7029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.226730:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269248 00000100:00100000:3.0:1789135774.226742:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269248 00000100:00100000:3.0:1789135774.226806:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135774.226816:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7029:x1876044723269248:12345-0@lo:5: 00002000:00080000:3.0:1789135774.226851:0:6698:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789135774.226856:0:6698:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789135774.227561:0:7029:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135774.227729:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7029:x1876044723269248:12345-0@lo:5: Request processed in 886us (2620us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789135774.227739:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789135774.227936:0:7029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e30c0 x1876044723269248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135774.227952:0:7029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269248:0@lo:5: 00000004:00080000:0.0:1789135774.227966:0:7029:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789135774.228028:0:7029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269376:0@lo:700: 00000100:00100000:0.0:1789135774.228070:0:7029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.228468:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269376 00000100:00100000:3.0:1789135774.228476:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269376 00000100:00100000:3.0:1789135774.228540:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135774.228550:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7029:x1876044723269376:12345-0@lo:700: 00000100:00100000:3.0:1789135774.228591:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1876044723269504:0@lo:700: 00000100:00100000:3.0:1789135774.228626:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.228648:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0604e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135774.228825:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269504 00000100:00100000:1.0:1789135774.228844:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269504 00000100:00100000:0.0:1789135774.229347:0:7029:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135774.229411:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135774.229422:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1876044723269504:12345-0@lo:700: 40000000:02000000:0.0:1789135774.370932:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789135774.380530:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6706:x1876044723269504:12345-0@lo:700: Request processed in 151103us (151896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.380552:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789135774.381590:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c09b840 x1876044723269504/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135790 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.381609:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6706:1876044723269504:0@lo:700: 40000000:02000000:1.0:1789135774.381624:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1789135774.514179:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789135774.514200:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789135774.514877:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7029:x1876044723269376:12345-0@lo:700: Request processed in 286321us (286798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135774.514890:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789135774.514999:0:7029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e1e00 x1876044723269376/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135774.515012:0:7029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789135774.515035:0:7029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269376:0@lo:700: 00010000:00010000:1.0:1789135774.548873:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1789135774.588351:0:7029:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789135774.596497:0:7029:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269632:0@lo:5: 00000100:00100000:3.0:1789135774.596587:0:7029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.596656:0:7029:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135774.597237:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269632 00000100:00100000:1.0:1789135774.597246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269632 00000100:00100000:1.0:1789135774.597306:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135774.597315:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7029:x1876044723269632:12345-0@lo:5: 00002000:00080000:0.0:1789135774.609685:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789135774.609741:0:6697:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789135774.623329:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7029:x1876044723269632:12345-0@lo:5: Request processed in 26002us (26727us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789135774.623348:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789135774.625076:0:7029:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c09bc00 x1876044723269632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135790 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135774.625105:0:7029:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7029:1876044723269632:0@lo:5: 00000004:00080000:2.0:1789135774.625129:0:7029:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:3.0:1789135774.646483:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789135775.574895:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135776.590359:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135777.613085:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135778.638663:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135779.533156:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723269888:0@lo:400: 00000100:00100000:1.0:1789135779.533239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.539507:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135779.539540:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723269760:0@lo:400: 00000100:00100000:1.0:1789135779.539653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.539767:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269888 00000100:00100000:1.0:1789135779.539777:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269888 00000100:00100000:1.0:1789135779.539853:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135779.539863:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723269888:12345-0@lo:400: 00000100:00100000:1.0:1789135779.539937:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723269888:12345-0@lo:400: Request processed in 76us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.539946:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135779.539978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723269760 00000100:00100000:1.0:1789135779.539981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723269760 00000100:00100000:1.0:1789135779.541365:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135779.541378:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3312:x1876044723269760:12345-0@lo:400: 00000100:00100000:1.0:1789135779.541457:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3312:x1876044723269760:12345-0@lo:400: Request processed in 83us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.541465:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135779.541533:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723269760:0@lo:400: 00010000:00080000:1.0:1789135779.541550:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c247c00 x1876044723269888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135779.541564:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723269888:0@lo:400: 00000100:00100000:0.0:1789135779.542217:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c2470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723270016:0@lo:400: 00000100:00100000:0.0:1789135779.542266:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135779.542295:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135779.542302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723270144:0@lo:400: 00000100:00100000:0.0:1789135779.542329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135779.542381:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270016 00000100:00100000:0.0:1789135779.542387:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270016 00000100:00100000:0.0:1789135779.542429:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135779.542436:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723270016:12345-0@lo:400: 00000100:00100000:0.0:1789135779.542476:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723270016:12345-0@lo:400: Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.542483:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135779.542502:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270144 00000100:00100000:0.0:1789135779.542505:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270144 00000100:00100000:0.0:1789135779.542531:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135779.542537:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723270144:12345-0@lo:400: 00000100:00100000:0.0:1789135779.542566:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723270144:12345-0@lo:400: Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.542572:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789135779.542587:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135779.542591:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135779.542608:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c246d00 x1876044723270144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135779.542619:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723270144:0@lo:400: 00010000:00080000:0.0:1789135779.542629:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c2470c0 x1876044723270016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135779.542637:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c2470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723270016:0@lo:400: 00000100:00100000:0.0:1789135779.544415:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135779.544442:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723270272:0@lo:13: 00000100:00100000:0.0:1789135779.544510:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135779.544561:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270272 00000100:00100000:0.0:1789135779.544569:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270272 00000100:00100000:0.0:1789135779.544627:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135779.544636:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723270272:12345-0@lo:13: 00002000:00000024:0.0:1789135779.544668:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135779.544736:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723270272:12345-0@lo:13: Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.544744:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789135779.544779:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e2940 x1876044723270272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135779.544799:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723270272:0@lo:13: 00000001:00080000:0.0:1789135779.634401:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789135779.661433:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.686124:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135781.711173:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135782.734748:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135783.764096:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135784.655993:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723270400:0@lo:13: 00000100:00100000:2.0:1789135784.656090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135784.656174:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270400 00000100:00100000:2.0:1789135784.656180:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270400 00000100:00100000:2.0:1789135784.656236:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135784.656245:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723270400:12345-0@lo:13: 00002000:00000024:2.0:1789135784.656305:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135784.656349:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723270400:12345-0@lo:13: Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135784.656356:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789135784.656376:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135784.656407:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c398000 x1876044723270400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135784.656417:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789135784.656437:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723270400:0@lo:13: 00000100:00100000:2.0:1789135784.660017:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723270784:0@lo:400: 00000100:00100000:2.0:1789135784.660084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135784.661413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723270528:0@lo:400: 00000100:00100000:0.0:1789135784.661504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135784.661567:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135784.661574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c399a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723270656:0@lo:400: 00000100:00100000:0.0:1789135784.661598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135784.661628:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270784 00000100:00100000:0.0:1789135784.661636:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270784 00000100:00100000:0.0:1789135784.661731:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270656 00000100:00100000:0.0:1789135784.661734:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270656 00000100:00100000:0.0:1789135784.661751:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135784.661759:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723270784:12345-0@lo:400: 00000100:00100000:0.0:1789135784.661822:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723270784:12345-0@lo:400: Request processed in 64us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.661829:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135784.661857:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135784.661863:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723270656:12345-0@lo:400: 00000100:00100000:0.0:1789135784.661906:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723270656:12345-0@lo:400: Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.661912:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135784.662176:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270528 00000100:00100000:0.0:1789135784.662180:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270528 00000100:00100000:0.0:1789135784.662209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135784.662216:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3313:x1876044723270528:12345-0@lo:400: 00000100:00100000:0.0:1789135784.662246:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3313:x1876044723270528:12345-0@lo:400: Request processed in 31us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.662252:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789135784.662289:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135784.662330:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c39a1c0 x1876044723270784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135784.662345:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723270784:0@lo:400: 00010000:00080000:0.0:1789135784.662374:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c399a40 x1876044723270656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135784.662383:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c399a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723270656:0@lo:400: 00000100:00100000:0.0:1789135784.662390:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723270528:0@lo:400: 00010000:00010000:1.0:1789135784.782248:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135785.806500:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135786.830078:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135787.855538:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135788.876934:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789135789.088735:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789135789.088740:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789135789.088913:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b9f45966800 00000020:01000004:1.0:1789135789.088929:0:7644:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789135789.088942:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789135789.088955:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ba0503b1a48) 00000020:00000080:1.0:1789135789.088972:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789135789.116638:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789135789.117518:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789135789.141569:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789135789.153654:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789135789.153736:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789135789.154200:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789135789.154235:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789135789.154867:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789135789.154879:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789135789.154891:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x38eb79866bf95ea5 00000020:01000004:2.0:1789135789.154899:0:7644:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789135789.154921:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789135789.154924:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789135789.154930:0:7644:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789135789.154952:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789135789.154957:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789135789.196202:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789135789.196249:0:7644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.141@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789135789.196255:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789135789.196257:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135789.196259:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135789.196260:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135789.196262:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135789.196264:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135789.196265:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135789.196267:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135789.196269:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135789.196271:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135789.196272:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135789.196278:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789135789.196281:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135789.196282:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135789.196289:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135789.196290:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135789.196291:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135789.196292:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135789.196293:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135789.196294:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135789.196295:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135789.196296:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135789.196297:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135789.196334:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789135789.196358:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723270912:0@lo:253: 00000100:00100000:3.0:1789135789.196457:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.196529:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.196614:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723270912 00000100:00100000:1.0:1789135789.196624:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723270912 00000100:00100000:1.0:1789135789.196728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789135789.196740:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:7644:x1876044723270912:12345-0@lo:253: 20000000:01000000:1.0:1789135789.196797:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789135789.196802:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789135789.196814:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789135789.196818:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789135789.199736:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135789.200448:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789135789.200466:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789135789.200520:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789135789.200528:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789135789.201730:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789135789.201828:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789135789.204487:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789135789.204525:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.141@tcp 20000000:01000000:1.0:1789135789.204528:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.141@tcp (null) (null) (null) 00000040:00080000:1.0:1789135789.204662:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789135789.204672:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135789.204797:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789135789.204817:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.141@tcp (null) (null) 00000040:00080000:1.0:1789135789.204858:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789135789.204868:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135789.204921:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789135789.204987:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789135789.207571:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789135789.207606:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.141@tcp 20000000:01000000:1.0:1789135789.207608:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.141@tcp (null) (null) (null) 00000040:00080000:1.0:1789135789.207651:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789135789.207660:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789135789.208155:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789135789.208168:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.141@tcp (null) (null) 00000040:00080000:1.0:1789135789.208213:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789135789.208223:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135789.208279:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789135789.208318:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789135789.208556:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789135789.208560:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789135789.208566:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135789.208568:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135789.208570:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135789.208584:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789135789.208587:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789135789.208625:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789135789.208627:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789135789.209489:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789135789.209545:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789135789.209920:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789135789.210273:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789135789.210396:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789135789.210466:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789135789.210487:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789135789.210490:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789135789.211572:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789135789.213652:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789135789.213816:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789135789.214226:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789135789.214257:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789135789.214259:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789135789.216344:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789135789.216433:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789135789.216489:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789135789.217494:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789135789.217544:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789135789.218208:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789135789.218228:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789135789.218231:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789135789.219067:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789135789.219224:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789135789.219262:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789135789.219578:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789135789.219623:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789135789.219683:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789135789.220199:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789135789.220222:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220240:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220248:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220255:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220262:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220268:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220275:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220314:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220340:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.220355:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593aad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271040:0@lo:104: 00000100:00100000:0.0:1789135789.220428:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135789.220480:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220488:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.220496:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271168:0@lo:104: 00010000:00010000:0.0:1789135789.220521:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220529:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.220538:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271296:0@lo:104: 00010000:00010000:0.0:1789135789.220561:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.220568:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.220575:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593aa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271424:0@lo:104: 00010000:00010000:0.0:1789135789.220598:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.220613:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789135789.220615:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 16 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.220623:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271552:0@lo:104: 00000100:00100000:0.0:1789135789.220646:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.220684:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271040 00000100:00100000:2.0:1789135789.220720:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271040 00000100:00100000:2.0:1789135789.220762:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271552 00000100:00100000:2.0:1789135789.220765:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271552 00000100:00100000:2.0:1789135789.220780:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135789.220788:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0581fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:5842:x1876044723271040:12345-0@lo:104: 00010000:00010000:2.0:1789135789.220802:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135789.221015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135789.221026:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:5842:x1876044723271552:12345-0@lo:104: 00010000:00010000:1.0:1789135789.221035:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.221293:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.221315:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.221324:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.221333:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1789135789.221339:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:0.0:1789135789.221400:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.221613:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271168 00000100:00100000:0.0:1789135789.221618:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271168 00000100:00100000:0.0:1789135789.221640:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1789135789.221645:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271296 00000100:00100000:0.0:1789135789.221648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271296 00000100:00100000:0.0:1789135789.221658:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1789135789.221661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271424 00000100:00100000:0.0:1789135789.221664:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271424 00000100:00100000:3.0:1789135789.221789:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135789.221799:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:5842:x1876044723271168:12345-0@lo:104: 00010000:00010000:3.0:1789135789.221808:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.221900:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135789.221906:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:5842:x1876044723271168:12345-0@lo:104: Request processed in 110us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.221913:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135789.221931:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135789.221937:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5842:x1876044723271296:12345-0@lo:104: 00010000:00010000:3.0:1789135789.221944:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.221973:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135789.221978:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:5842:x1876044723271296:12345-0@lo:104: Request processed in 42us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.221983:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135789.221995:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135789.222001:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:5842:x1876044723271424:12345-0@lo:104: 00010000:00010000:3.0:1789135789.222007:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.222032:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789135789.222036:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:5842:x1876044723271424:12345-0@lo:104: Request processed in 36us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.222042:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789135789.222275:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789135789.222283:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222291:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135789.222295:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222304:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135789.222311:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135789.222317:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135789.222360:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222371:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135789.222392:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222398:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95e66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222411:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135789.222414:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222420:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e600 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135789.222422:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222429:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135789.222434:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135789.222439:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135789.222452:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222458:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135789.222472:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222478:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e600/0x38eb79866bf95e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222495:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135789.222498:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222504:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0f200 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135789.222507:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222513:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135789.222519:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135789.222524:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135789.222537:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222542:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135789.222547:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222554:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0f200/0x38eb79866bf95e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e27 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.222563:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135789.222565:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135789.222567:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135789.222576:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135789.222595:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723271680:0@lo:103: 00000100:00100000:0.0:1789135789.222636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.222669:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723271808:0@lo:103: 00000100:00100000:0.0:1789135789.222987:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.223009:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135789.223015:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723271936:0@lo:103: 00000100:00100000:0.0:1789135789.223039:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.223066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271680 00000100:00100000:0.0:1789135789.223071:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271680 00010000:00010000:2.0:1789135789.223073:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135789.223079:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0581fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:5842:x1876044723271040:12345-0@lo:104: Request processed in 2291us (2651us total) trans 0 rc 0/0 00010000:00010000:0.0:1789135789.223092:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 17 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.223098:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789135789.223160:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135789.223164:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.223171:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:2.0:1789135789.223174:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223190:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271808 00000100:00100000:0.0:1789135789.223194:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271808 00010000:00010000:0.0:1789135789.223208:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 18 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223219:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723271936 00000100:00100000:0.0:1789135789.223222:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723271936 00010000:00010000:0.0:1789135789.223232:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 19 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223244:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135789.223251:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723271680:12345-0@lo:103: 00010000:00010000:0.0:1789135789.223265:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135789.223270:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 19 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223279:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 19 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223315:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135789.223351:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723271680:12345-0@lo:103: Request processed in 101us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.223358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135789.223371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135789.223377:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3313:x1876044723271808:12345-0@lo:103: 00010000:00010000:0.0:1789135789.223384:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135789.223388:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 18 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223395:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 18 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223404:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135789.223430:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3313:x1876044723271808:12345-0@lo:103: Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.223436:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789135789.223448:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135789.223454:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3313:x1876044723271936:12345-0@lo:103: 10000000:00010000:2.0:1789135789.223456:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.223461:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135789.223461:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135789.223464:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 17 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223471:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 17 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.223479:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.223480:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135789.223494:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135789.223502:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223506:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3313:x1876044723271936:12345-0@lo:103: Request processed in 52us (466us total) trans 0 rc 0/0 00010000:00010000:2.0:1789135789.223509:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf95e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789135789.223521:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.223523:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.223525:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135789.223539:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723272064:0@lo:103: 00000100:00100000:0.0:1789135789.223563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.223603:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723271680:0@lo:103: 00000100:00100000:0.0:1789135789.223633:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723271936:0@lo:103: 00000100:00100000:0.0:1789135789.223640:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723271808:0@lo:103: 00000100:00100000:0.0:1789135789.223662:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593aad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271040:0@lo:104: 00010000:00010000:0.0:1789135789.223672:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95e6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e66 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223683:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271168:0@lo:104: 00010000:00010000:0.0:1789135789.223727:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf95e51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e4a expref: 15 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.223728:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272064 00000100:00100000:2.0:1789135789.223732:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272064 00000100:00100000:0.0:1789135789.223736:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271296:0@lo:104: 00010000:00010000:0.0:1789135789.223745:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf95e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e20 expref: 15 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.223758:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593aa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271424:0@lo:104: 00010000:00010000:2.0:1789135789.223763:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 14 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.223782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135789.223788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3311:x1876044723272064:12345-0@lo:103: 00010000:00010000:0.0:1789135789.223794:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.223795:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135789.223799:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 14 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.223822:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 14 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.223833:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf95e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e90 expref: 14 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.223843:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135789.224013:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3311:x1876044723272064:12345-0@lo:103: Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.224028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135789.224054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723272064:0@lo:103: 00010000:00010000:1.0:1789135789.224257:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135789.224264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5842:x1876044723271552:12345-0@lo:104: Request processed in 3241us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.224277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789135789.224314:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135789.224327:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.224331:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1876044723271552:0@lo:104: 00010000:00010000:2.0:1789135789.224336:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030a00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:2.0:1789135789.224338:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.224346:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.224351:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135789.224353:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.224358:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135789.224389:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.224396:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135789.224425:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.224432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95dfd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.224446:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.224447:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.224455:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135789.225310:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723272192:0@lo:103: 00000100:00100000:0.0:1789135789.225367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.225491:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272192 00000100:00100000:2.0:1789135789.225497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272192 00010000:00010000:2.0:1789135789.225519:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 13 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.225576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135789.225584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3312:x1876044723272192:12345-0@lo:103: 00010000:00010000:2.0:1789135789.225594:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135789.225599:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 13 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225610:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 13 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225624:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95df6 expref: 13 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225637:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225644:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225659:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225666:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225674:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225738:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225745:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135789.225750:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225759:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225779:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.225790:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135789.226244:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.226253:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.226269:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95eac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789135789.226291:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789135789.226393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3312:x1876044723272192:12345-0@lo:103: Request processed in 809us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.226402:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135789.226436:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723272192:0@lo:103: 00000100:00100000:3.0:1789135789.283224:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:7644:x1876044723270912:12345-0@lo:253: Request processed in 86476us (86756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.283245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135789.283436:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723270912:0@lo:253: 10000000:01000000:0.0:1789135789.283456:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789135789.283461:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135789.283463:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135789.283464:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135789.283465:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789135789.283467:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135789.283468:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135789.283470:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135789.283472:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789135789.283474:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135789.283475:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789135789.283496:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b9f45966800 from lustre-OST0001 10000000:01000000:0.0:1789135789.283521:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789135789.283524:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789135789.283533:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ba0592cced8 local copy 10000000:01000000:0.0:1789135789.283537:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135789.283583:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.283595:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.283605:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.283726:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593aa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272320:0@lo:101: 00000100:00100000:0.0:1789135789.283769:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.283879:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.283987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272320 00000100:00100000:1.0:1789135789.283994:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272320 00000100:00100000:1.0:1789135789.284044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789135789.284057:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+11:7644:x1876044723272320:12345-0@lo:101: 00010000:00010000:1.0:1789135789.284077:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135789.284099:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95eb3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.284128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95eb3 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.284140:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95eb3 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.284150:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9a00, rc 0) 00000100:00100000:1.0:1789135789.284258:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723272320:12345-0@lo:101: Request processed in 204us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.284265:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135789.284436:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593aa940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272320:0@lo:101: 00010000:00010000:3.0:1789135789.284453:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.284463:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.284597:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272448:0@lo:501: 00000100:00100000:3.0:1789135789.285214:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.285244:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.285355:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272448 00000100:00100000:0.0:1789135789.285361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272448 00000100:00100000:0.0:1789135789.285399:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135789.285407:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723272448:12345-0@lo:501: 00000100:00100000:3.0:1789135789.285822:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272448:0@lo:501: 10000000:01000000:3.0:1789135789.285840:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789135789.285868:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789135789.285875:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.285884:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.285891:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.285923:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789135789.285944:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b9f45966800 10000000:01000000:3.0:1789135789.285949:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135789.285954:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789135789.285957:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135789.285961:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789135789.285964:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789135789.285986:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.285994:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.286003:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.286016:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272576:0@lo:101: 00000100:00100000:3.0:1789135789.286045:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.286080:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.286193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272576 00000100:00100000:2.0:1789135789.286197:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272576 00000100:00100000:2.0:1789135789.286238:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135789.286244:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723272576:12345-0@lo:101: 00010000:00010000:2.0:1789135789.286253:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135789.286265:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95ec1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.286284:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.286293:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.286307:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e800, rc 0) 00000100:00100000:2.0:1789135789.286344:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723272576:12345-0@lo:101: Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.286351:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1789135789.286500:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135789.286507:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286514:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135789.286518:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286537:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135789.286545:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135789.286551:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135789.286571:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286578:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135789.286600:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286607:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x38eb79866bf95eba expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286632:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135789.286634:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135789.286636:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135789.286644:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135789.286655:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723272704:0@lo:103: 00000100:00100000:1.0:1789135789.286682:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.286756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272704 00000100:00100000:1.0:1789135789.286760:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272704 00000100:00100000:1.0:1789135789.286785:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135789.286792:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3314:x1876044723272704:12345-0@lo:103: 00010000:00010000:1.0:1789135789.286800:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135789.286821:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf95eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95eb3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.286836:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135789.286865:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3314:x1876044723272704:12345-0@lo:103: Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.286872:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135789.286911:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723272704:0@lo:103: 00000100:00100000:3.0:1789135789.287127:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272576:0@lo:101: 00010000:00010000:3.0:1789135789.287140:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.287148:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.287229:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272832:0@lo:501: 00000100:00100000:3.0:1789135789.287261:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.287280:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.287360:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272832 00000100:00100000:2.0:1789135789.287365:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272832 00000100:00100000:2.0:1789135789.287390:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135789.287395:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723272832:12345-0@lo:501: 00000100:00100000:2.0:1789135789.287569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723272832:12345-0@lo:501: Request processed in 172us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.287576:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789135789.287756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723272448:12345-0@lo:501: Request processed in 208us (409us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135789.287766:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789135789.288050:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272832:0@lo:501: 00000100:00100000:3.0:1789135789.288079:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272960:0@lo:503: 00000100:00100000:3.0:1789135789.288114:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.288141:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.288541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723272960 00000100:00100000:2.0:1789135789.288547:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723272960 00000100:00100000:2.0:1789135789.288584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789135789.288592:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723272960:12345-0@lo:503: 00000100:00100000:2.0:1789135789.288855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723272960:12345-0@lo:503: Request processed in 262us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.288863:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135789.289005:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723272960:0@lo:503: 00000040:00080000:3.0:1789135789.289271:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135789.289415:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273088:0@lo:502: 00000100:00100000:3.0:1789135789.289450:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.289479:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.289594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273088 00000100:00100000:0.0:1789135789.289599:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273088 00000100:00100000:0.0:1789135789.289642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789135789.289651:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723273088:12345-0@lo:502: 00000100:00100000:0.0:1789135789.289831:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723273088:12345-0@lo:502: Request processed in 180us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.289838:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135789.290032:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273088:0@lo:502: 00000040:00080000:3.0:1789135789.290291:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789135789.290474:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789135789.290517:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789135789.290575:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789135789.290792:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789135789.290981:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789135789.291016:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273216:0@lo:502: 00000100:00100000:3.0:1789135789.291072:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.291113:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.291222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273216 00000100:00100000:1.0:1789135789.291228:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273216 00000100:00100000:1.0:1789135789.291270:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135789.291279:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723273216:12345-0@lo:502: 00000100:00100000:1.0:1789135789.292056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723273216:12345-0@lo:502: Request processed in 776us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.292065:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789135789.292429:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273216:0@lo:502: 00000040:00080000:2.0:1789135789.292742:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789135789.292756:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789135789.293531:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135789.293538:0:7654:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789135789.293543:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135789.293545:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789135789.293550:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135789.293571:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ba074339a48) 00000020:00000080:2.0:1789135789.293592:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789135789.293597:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789135789.293930:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b9f45966800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789135789.293939:0:7654:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789135789.293945:0:7654:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x38eb79866bf95ed6 00010000:00010000:2.0:1789135789.298697:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789135789.299283:0:7654:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789135789.302695:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789135789.303052:0:7654:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789135789.317776:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789135789.318254:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789135789.324719:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789135789.324742:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135789.324756:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.324758:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789135789.324762:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135789.324766:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.324767:0:7654:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135789.324770:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135789.324772:0:7654:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135789.324866:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135789.324871:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.324872:0:7654:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135789.324878:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789135789.325358:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789135789.325387:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789135789.325409:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.325423:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135789.325431:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b9f45966800 from 1 10000000:01000000:0.0:1789135789.325433:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135789.325467:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.325473:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.325497:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.325519:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273344:0@lo:101: 00000100:00100000:0.0:1789135789.325589:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.327052:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.327764:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273344 00000100:00100000:3.0:1789135789.327781:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273344 00000100:00100000:3.0:1789135789.327849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135789.327858:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:7644:x1876044723273344:12345-0@lo:101: 00010000:00010000:3.0:1789135789.327885:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135789.327903:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95edd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.327930:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95edd expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.327942:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95edd expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.327951:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cd800, rc 0) 00000100:00100000:3.0:1789135789.328022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273344:12345-0@lo:101: Request processed in 165us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.328029:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789135789.328199:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273344:0@lo:101: 00010000:00010000:0.0:1789135789.328217:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.328227:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.328350:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273472:0@lo:501: 00000100:00100000:0.0:1789135789.328384:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.328420:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.328428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273472 00000100:00100000:1.0:1789135789.328433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273472 00000100:00100000:1.0:1789135789.328459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135789.328465:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273472:12345-0@lo:501: 00000100:00100000:1.0:1789135789.328744:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273472:12345-0@lo:501: Request processed in 278us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.328752:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789135789.329029:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273472:0@lo:501: 00000100:00100000:0.0:1789135789.329059:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273600:0@lo:503: 00000100:00100000:0.0:1789135789.329096:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.329125:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.329172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273600 00000100:00100000:1.0:1789135789.329187:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273600 00000100:00100000:1.0:1789135789.329229:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135789.329236:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273600:12345-0@lo:503: 00000100:00100000:1.0:1789135789.329533:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273600:12345-0@lo:503: Request processed in 296us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.329541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789135789.329723:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273600:0@lo:503: 00000040:00080000:0.0:1789135789.330052:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135789.330128:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273728:0@lo:502: 00000100:00100000:0.0:1789135789.330166:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.330191:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.330879:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273728 00000100:00100000:1.0:1789135789.331193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273728 00000100:00100000:1.0:1789135789.331282:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135789.331292:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273728:12345-0@lo:502: 00000100:00100000:1.0:1789135789.331793:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273728:12345-0@lo:502: Request processed in 501us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.331806:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789135789.331921:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273728:0@lo:502: 00000040:00080000:3.0:1789135789.332231:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789135789.332311:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789135789.333486:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273856:0@lo:502: 00000100:00100000:3.0:1789135789.333569:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.333677:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.336789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273856 00000100:00100000:2.0:1789135789.336809:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273856 00000100:00100000:2.0:1789135789.336889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135789.336900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273856:12345-0@lo:502: 00000100:00100000:2.0:1789135789.337171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273856:12345-0@lo:502: Request processed in 273us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.337179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135789.337816:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273856:0@lo:502: 00000040:00080000:2.0:1789135789.345160:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789135789.345191:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789135789.346096:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135789.346111:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.346114:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135789.346121:0:7658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b9f45966800 00000020:00000080:1.0:1789135789.346124:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789135789.346146:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135789.346149:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.346151:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135789.346154:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789135789.346302:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789135789.346328:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135789.346358:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.346370:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135789.346441:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789135789.346444:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b9f45966800 10000000:01000000:3.0:1789135789.346448:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b9f45966800 10000000:01000000:3.0:1789135789.346452:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135789.346458:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b9f45966800 from 1 10000000:01000000:3.0:1789135789.346461:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789135789.346511:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.346520:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.346533:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.346563:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273984:0@lo:101: 00000100:00100000:3.0:1789135789.346644:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.346735:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723273984 00000100:00100000:3.0:1789135789.346737:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.346745:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723273984 00000100:00100000:0.0:1789135789.346822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789135789.346834:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723273984:12345-0@lo:101: 00010000:00010000:0.0:1789135789.346851:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135789.346866:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95eeb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.346905:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.346918:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.346929:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031e00, rc 0) 00000100:00100000:0.0:1789135789.346985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723273984:12345-0@lo:101: Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.346995:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135789.347039:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723273984:0@lo:101: 00010000:00010000:3.0:1789135789.347057:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.347066:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.347182:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274112:0@lo:501: 00000100:00100000:3.0:1789135789.347209:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.347241:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.347291:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274112 00000100:00100000:1.0:1789135789.347296:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274112 00000100:00100000:1.0:1789135789.347328:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135789.347354:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274112:12345-0@lo:501: 00000100:00100000:1.0:1789135789.347609:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274112:12345-0@lo:501: Request processed in 256us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.347617:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789135789.347779:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274112:0@lo:501: 00000100:00100000:2.0:1789135789.347818:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274240:0@lo:503: 00000100:00100000:2.0:1789135789.347864:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.347893:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.347985:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274240 00000100:00100000:3.0:1789135789.347990:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274240 00000100:00100000:3.0:1789135789.348028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789135789.348035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274240:12345-0@lo:503: 00000100:00100000:3.0:1789135789.348191:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274240:12345-0@lo:503: Request processed in 155us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.348197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135789.348233:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274240:0@lo:503: 00000040:00080000:2.0:1789135789.348509:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135789.348569:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274368:0@lo:502: 00000100:00100000:2.0:1789135789.348601:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.348633:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.349397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274368 00000100:00100000:0.0:1789135789.349404:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274368 00000100:00100000:0.0:1789135789.349449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789135789.349457:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274368:12345-0@lo:502: 00000100:00100000:1.0:1789135789.356024:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274368:12345-0@lo:502: Request processed in 6555us (7410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.356039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135789.356385:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274368:0@lo:502: 00000040:00080000:3.0:1789135789.356820:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789135789.356905:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789135789.356944:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789135789.357005:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789135789.357043:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789135789.357090:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789135789.357121:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789135789.357150:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789135789.357207:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789135789.357258:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789135789.357292:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789135789.357336:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789135789.357373:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789135789.357409:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789135789.357456:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789135789.357494:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789135789.357530:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789135789.357576:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789135789.357612:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789135789.357646:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789135789.357744:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789135789.357785:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789135789.357834:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789135789.358436:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789135789.358484:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789135789.358542:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789135789.358594:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789135789.358632:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789135789.358665:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789135789.359039:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789135789.359089:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789135789.359135:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789135789.359162:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789135789.359201:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789135789.359229:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789135789.359266:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789135789.359293:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789135789.359353:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274496:0@lo:502: 00000100:00100000:2.0:1789135789.359434:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.359480:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.359608:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274496 00000100:00100000:1.0:1789135789.359615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274496 00000100:00100000:1.0:1789135789.359663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135789.359672:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274496:12345-0@lo:502: 00000100:00100000:1.0:1789135789.360184:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723274496:12345-0@lo:502: Request processed in 511us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.360193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789135789.360386:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723274496:0@lo:502: 00000040:00080000:2.0:1789135789.360475:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789135789.360486:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789135789.361349:0:7659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789135789.361380:0:7659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b9f465c0000) 00000020:00000080:2.0:1789135789.361401:0:7659:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789135789.361484:0:7659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b9f45966800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789135789.361489:0:7659:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b9f45966800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789135789.361492:0:7659:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b9f45966800 3 00010000:00080000:2.0:1789135789.361523:0:7659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b9f463a1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.141@tcp at head 00010000:00010000:2.0:1789135789.368607:0:7659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789135789.370739:0:7659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789135789.370795:0:7659:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789135789.370813:0:7659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x38eb79866bf95f00 00000100:00080000:2.0:1789135789.370827:0:7659:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135789.370834:0:7659:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b9f463a1800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789135789.372618:0:7659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c3983c0 x1876044723274624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135789.372673:0:7659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789135789.372743:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723274624:0@lo:38: 00000100:00100000:1.0:1789135789.372839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.372852:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135789.372905:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723274880:0@lo:400: 00000100:00100000:3.0:1789135789.372918:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723274752:0@lo:400: 00000100:00100000:1.0:1789135789.372931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.372959:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135789.372965:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723275008:0@lo:400: 00000100:00100000:1.0:1789135789.372991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.373021:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274624 00000100:00100000:1.0:1789135789.373027:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274624 00000100:00100000:1.0:1789135789.373054:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274880 00000100:00100000:1.0:1789135789.373056:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274880 00000100:00100000:1.0:1789135789.373105:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135789.373114:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723274880:12345-0@lo:400: 00000100:00100000:1.0:1789135789.373170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723274880:12345-0@lo:400: Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.373178:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135789.373193:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135789.373197:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723274624:12345-0@lo:38: 00010000:00080000:1.0:1789135789.373230:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:1.0:1789135789.373264:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x38eb79866bf95f07 00000004:00100000:1.0:1789135789.373278:0:5852:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789135789.373308:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8b9f45965000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135789.373344:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876044723274624:12345-0@lo:38: Request processed in 145us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.373350:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135789.373370:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275008 00000100:00100000:1.0:1789135789.373373:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275008 00000100:00100000:1.0:1789135789.373399:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135789.373406:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723275008:12345-0@lo:400: 00000100:00100000:1.0:1789135789.373435:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723275008:12345-0@lo:400: Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.373441:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789135789.373460:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135789.373464:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135789.373577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135789.373582:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e0b40 x1876044723275008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.373595:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723275008:0@lo:400: 00010000:00080000:1.0:1789135789.373606:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3e3840 x1876044723274880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.373637:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723274880:0@lo:400: 00010000:00080000:1.0:1789135789.373671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c3983c0 x1876044723274624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.373678:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789135789.373694:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789135789.373731:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789135789.373736:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789135789.373738:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789135789.373744:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723274624:0@lo:38: 00000100:00100000:1.0:1789135789.373763:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723274752 00000100:00100000:1.0:1789135789.373767:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723274752 00000100:00100000:1.0:1789135789.373795:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789135789.373801:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723274752:12345-0@lo:400: 00000100:00100000:1.0:1789135789.373834:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723274752:12345-0@lo:400: Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.373840:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789135789.373944:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c09a580 x1876044723274752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135789.373952:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723274752:0@lo:400: 00000040:00080000:1.0:1789135789.373995:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789135789.374135:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246580 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876044723275136:0@lo:901: 00000100:00100000:1.0:1789135789.374166:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.374190:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275136 00000100:00100000:1.0:1789135789.374193:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275136 00000100:00100000:1.0:1789135789.374220:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135789.374226:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876044723275136:12345-0@lo:901: 00000020:01000000:3.0:1789135789.374491:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789135789.374516:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135789.374532:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.374544:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135789.374586:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135789.374588:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135789.374590:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135789.374591:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1789135789.374592:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876044723275136:12345-0@lo:901: Request processed in 365us (425us total) trans 0 rc 0/0 00000020:01000004:3.0:1789135789.374593:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135789.374594:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135789.374596:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135789.374598:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135789.374599:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135789.374601:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135789.374603:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1789135789.374606:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:3.0:1789135789.374609:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789135789.374612:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135789.374613:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135789.374614:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135789.374615:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135789.374616:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135789.374617:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135789.374618:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135789.374618:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135789.374619:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135789.374620:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135789.374621:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:1.0:1789135789.374623:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789135789.374635:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789135789.374640:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.374644:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723275264:0@lo:253: 00010000:00080000:1.0:1789135789.374656:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c246580 x1876044723275136/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789135805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.374666:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246580 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876044723275136:0@lo:901: 00000100:00100000:3.0:1789135789.374676:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.374745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275264 00000100:00100000:1.0:1789135789.374750:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275264 00000100:00100000:3.0:1789135789.374762:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.374777:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135789.374784:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:7644:x1876044723275264:12345-0@lo:253: 20000000:01000000:1.0:1789135789.374805:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789135789.374820:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789135789.422978:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789135789.423036:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789135789.425482:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789135789.425493:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789135789.425518:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.425537:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.425567:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.425625:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.425639:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 14 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.425655:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593aa580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723275392:0@lo:104: 00000100:00100000:0.0:1789135789.427412:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.427474:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.427569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275392 00000100:00100000:1.0:1789135789.427579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275392 00000100:00100000:1.0:1789135789.427649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135789.427660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723275392:12345-0@lo:104: 00010000:00010000:1.0:1789135789.427678:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.428200:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135789.428207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:5866:x1876044723275392:12345-0@lo:104: Request processed in 549us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.428214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789135789.428450:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135789.428458:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.428466:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:2.0:1789135789.428470:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.428478:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135789.428484:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.428489:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135789.428524:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.428529:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135789.428549:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.428555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9000/0x38eb79866bf95e58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.428572:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.428574:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135789.428575:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135789.428614:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723275520:0@lo:103: 00000100:00100000:2.0:1789135789.428659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.428764:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593aa580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1876044723275392:0@lo:104: 00010000:00010000:2.0:1789135789.428787:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.429103:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275520 00000100:00100000:0.0:1789135789.429109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275520 00010000:00010000:0.0:1789135789.429209:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 15 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.429367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135789.429377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba049181450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:3313:x1876044723275520:12345-0@lo:103: 00010000:00010000:0.0:1789135789.429483:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135789.429490:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 15 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429502:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 15 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429520:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030200/0x38eb79866bf95e5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e58 expref: 15 pid: 5842 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429550:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429558:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135789.429574:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004081553s 00010000:00010000:0.0:1789135789.429580:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429588:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429609:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429617:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429623:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135789.429627:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429634:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429657:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.429668:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135789.429763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba049181450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3313:x1876044723275520:12345-0@lo:103: Request processed in 386us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.429770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135789.430174:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723275520:0@lo:103: 00010000:00010000:1.0:1789135789.430264:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.430276:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.430291:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.437165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:7644:x1876044723275264:12345-0@lo:253: Request processed in 62372us (62478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.437178:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135789.437308:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:7644:1876044723275264:0@lo:253: 10000000:01000000:0.0:1789135789.437325:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789135789.437329:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135789.437331:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135789.437332:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135789.437333:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135789.437334:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135789.437336:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135789.437338:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135789.437340:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135789.437342:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135789.437343:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135789.437345:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789135789.437358:0:7644:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789135789.451915:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135789.452112:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135789.452313:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135789.452512:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135789.458382:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135789.458609:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789135789.464906:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789135789.773002:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135789.773035:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723275648:0@lo:13: 00000100:00100000:1.0:1789135789.773117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.775747:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275648 00000100:00100000:2.0:1789135789.775767:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275648 00000100:00100000:2.0:1789135789.775853:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135789.775866:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723275648:12345-0@lo:13: 00002000:00000024:2.0:1789135789.775916:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135789.776031:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723275648:12345-0@lo:13: Request processed in 168us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.776039:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789135789.776091:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba05c39a580 x1876044723275648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.776117:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723275648:0@lo:13: 00002000:00080000:0.0:1789135789.782651:0:7644:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789135789.782664:0:7644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789135789.782741:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789135789.782814:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789135789.782839:0:7644:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789135789.782878:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789135789.901979:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135790.924903:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135791.951659:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135792.977951:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135793.997071:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135794.380988:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723275776:0@lo:400: 00000100:00100000:3.0:1789135794.381061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.381109:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723276288:0@lo:400: 00000100:00100000:3.0:1789135794.381140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.381167:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135794.381173:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723275904:0@lo:400: 00000100:00100000:3.0:1789135794.381208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.382841:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723276032:0@lo:400: 00000100:00100000:3.0:1789135794.382929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.382992:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135794.383016:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723276160:0@lo:400: 00000100:00100000:3.0:1789135794.383050:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.383093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275776 00000100:00100000:3.0:1789135794.383104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275776 00000100:00100000:3.0:1789135794.383158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789135794.383166:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3311:x1876044723275776:12345-0@lo:400: 00000100:00100000:3.0:1789135794.384869:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3311:x1876044723275776:12345-0@lo:400: Request processed in 1692us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.384884:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789135794.384953:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276288 00000100:00100000:3.0:1789135794.384959:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276288 00000100:00100000:3.0:1789135794.385011:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723275904 00000100:00100000:3.0:1789135794.385015:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723275904 00000100:00100000:3.0:1789135794.385027:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276032 00000100:00100000:3.0:1789135794.385030:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276032 00000100:00100000:3.0:1789135794.385048:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135794.385055:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723276288:12345-0@lo:400: 00000100:00100000:3.0:1789135794.385099:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723276288:12345-0@lo:400: Request processed in 45us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.385105:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135794.385117:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135794.385123:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723275904:12345-0@lo:400: 00000100:00100000:3.0:1789135794.385150:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723275904:12345-0@lo:400: Request processed in 27us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.385156:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135794.385166:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135794.385172:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723276032:12345-0@lo:400: 00000100:00100000:3.0:1789135794.385221:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723276032:12345-0@lo:400: Request processed in 49us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.385240:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135794.385269:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276160 00000100:00100000:3.0:1789135794.385274:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276160 00000100:00100000:3.0:1789135794.385303:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135794.385311:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723276160:12345-0@lo:400: 00000100:00100000:3.0:1789135794.385345:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723276160:12345-0@lo:400: Request processed in 35us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.385351:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789135794.385369:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135794.385374:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135794.385820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c09a580 x1876044723276160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135794.385836:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723276160:0@lo:400: 00010000:00080000:3.0:1789135794.385852:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c3e0b40 x1876044723276032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135794.385861:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723276032:0@lo:400: 00010000:00080000:3.0:1789135794.385903:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c3e3840 x1876044723275904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135794.385913:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723275904:0@lo:400: 00000100:00100000:3.0:1789135794.385924:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723275776:0@lo:400: 00010000:00080000:3.0:1789135794.385934:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba07c1b9e00 x1876044723276288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135794.385942:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723276288:0@lo:400: 00000100:00100000:3.0:1789135794.893366:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723276416:0@lo:13: 00000100:00100000:3.0:1789135794.897538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135794.900826:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276416 00000100:00100000:2.0:1789135794.900845:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276416 00000100:00100000:2.0:1789135794.900921:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135794.900933:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723276416:12345-0@lo:13: 00002000:00000024:2.0:1789135794.900989:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135794.901114:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723276416:12345-0@lo:13: Request processed in 183us (3587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.901122:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789135794.901205:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c39a580 x1876044723276416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135794.901232:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723276416:0@lo:13: 00010000:00010000:0.0:1789135795.024939:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135796.056060:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135797.069832:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135798.100898:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135798.561320:0:8003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789135799.000093:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135799.000099:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba0504e6000 from 30 10000000:01000000:1.0:1789135799.000104:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135799.000153:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000166:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000178:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135799.000204:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276544:0@lo:101: 00000100:00100000:1.0:1789135799.000299:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.000351:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.000372:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276544 00000100:00100000:1.0:1789135799.000378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276544 00000100:00100000:1.0:1789135799.000427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135799.000447:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723276544:12345-0@lo:101: 00010000:00010000:1.0:1789135799.000461:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135799.000474:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f15 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000497:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000519:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000527:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9e00, rc 0) 00000100:00100000:1.0:1789135799.000566:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723276544:12345-0@lo:101: Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.000573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135799.000617:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276544:0@lo:101: 00010000:00010000:1.0:1789135799.000631:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.000639:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135799.000688:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276672:0@lo:501: 00000100:00100000:1.0:1789135799.000734:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.000755:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67b40 going to sleep for 10 seconds 00000100:00100000:1.0:1789135799.000768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276672 00000100:00100000:1.0:1789135799.000772:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276672 00000100:00100000:1.0:1789135799.000792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135799.000798:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723276672:12345-0@lo:501: 00000100:00100000:1.0:1789135799.001135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723276672:12345-0@lo:501: Request processed in 336us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.001143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135799.001179:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276672:0@lo:501: 00000100:00100000:1.0:1789135799.001208:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276800:0@lo:503: 00000100:00100000:1.0:1789135799.001245:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.001259:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.001270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276800 00000100:00100000:1.0:1789135799.001274:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276800 00000100:00100000:1.0:1789135799.001295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789135799.001300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723276800:12345-0@lo:503: 00000100:00100000:1.0:1789135799.001597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723276800:12345-0@lo:503: Request processed in 295us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.001604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789135799.001647:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723276800:0@lo:503: 00000100:00100000:1.0:1789135799.001834:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8023:1876044723276928:0@lo:502: 00000100:00100000:1.0:1789135799.001867:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.001885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723276928 00000100:00100000:1.0:1789135799.001888:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723276928 00000100:00100000:1.0:1789135799.001908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789135799.001914:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8023:x1876044723276928:12345-0@lo:502: 00000100:00100000:1.0:1789135799.002109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8023:x1876044723276928:12345-0@lo:502: Request processed in 194us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.002114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789135799.002150:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.002168:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8023:1876044723276928:0@lo:502: 00000100:00100000:1.0:1789135799.002206:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8023:1876044723277056:0@lo:502: 00000100:00100000:1.0:1789135799.002238:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.002257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277056 00000100:00100000:1.0:1789135799.002260:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277056 00000100:00100000:1.0:1789135799.002281:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789135799.002286:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8023:x1876044723277056:12345-0@lo:502: 00000100:00100000:1.0:1789135799.002399:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8023:x1876044723277056:12345-0@lo:502: Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.002406:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789135799.002436:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.002447:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8023:1876044723277056:0@lo:502: 00000040:00080000:1.0:1789135799.002465:0:8023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789135799.002525:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789135799.002540:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135799.002547:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002557:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135799.002565:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789135799.002568:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789135799.002571:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135799.002592:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002599:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002612:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135799.002622:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277184:0@lo:101: 00000100:00100000:1.0:1789135799.002647:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.002659:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.002670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277184 00000100:00100000:1.0:1789135799.002673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277184 00000100:00100000:1.0:1789135799.002692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789135799.002721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723277184:12345-0@lo:101: 00010000:00010000:1.0:1789135799.002729:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135799.002740:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f23 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002757:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002765:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.002772:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8200, rc 0) 00000100:00100000:1.0:1789135799.002798:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277184:12345-0@lo:101: Request processed in 101us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.002804:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789135799.010119:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277184:0@lo:101: 00010000:00010000:1.0:1789135799.010151:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.010176:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135799.010266:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277312:0@lo:501: 00000100:00100000:1.0:1789135799.010333:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.010375:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135799.010792:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277312 00000100:00100000:3.0:1789135799.010800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277312 00000100:00100000:3.0:1789135799.010843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789135799.010853:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277312:12345-0@lo:501: 00000100:00100000:3.0:1789135799.011154:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277312:12345-0@lo:501: Request processed in 302us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135799.011162:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789135799.015890:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277312:0@lo:501: 00000100:00100000:1.0:1789135799.015952:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277440:0@lo:503: 00000100:00100000:1.0:1789135799.016042:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.016081:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.016230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277440 00000100:00100000:1.0:1789135799.016238:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277440 00000100:00100000:1.0:1789135799.016291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135799.016300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277440:12345-0@lo:503: 00000100:00100000:1.0:1789135799.018874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277440:12345-0@lo:503: Request processed in 2565us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.018887:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135799.018973:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277440:0@lo:503: 00000100:00100000:1.0:1789135799.019172:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8024:1876044723277568:0@lo:502: 00000100:00100000:1.0:1789135799.019215:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.021394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277568 00000100:00100000:1.0:1789135799.021403:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277568 00000100:00100000:1.0:1789135799.021450:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135799.021458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8024:x1876044723277568:12345-0@lo:502: 00000100:00100000:1.0:1789135799.022472:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8024:x1876044723277568:12345-0@lo:502: Request processed in 1011us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.022483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135799.022564:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.022586:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8024:1876044723277568:0@lo:502: 00000020:01000000:1.0:1789135799.023964:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135799.023998:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135799.024001:0:8024:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135799.024009:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135799.024011:0:8024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789135799.024052:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8024:1876044723277696:0@lo:502: 00000100:00100000:1.0:1789135799.024131:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.024163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277696 00000100:00100000:1.0:1789135799.024168:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277696 00000100:00100000:1.0:1789135799.024205:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135799.024213:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8024:x1876044723277696:12345-0@lo:502: 00000100:00100000:1.0:1789135799.031870:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8024:x1876044723277696:12345-0@lo:502: Request processed in 7647us (7728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.031885:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135799.032065:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.032102:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8024:1876044723277696:0@lo:502: 00000020:01000000:1.0:1789135799.032144:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135799.032152:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135799.032154:0:8024:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135799.032158:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789135799.034373:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789135799.034411:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789135799.034424:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.034453:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135799.034464:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135799.034466:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba04857c800 from 30 10000000:01000000:1.0:1789135799.034469:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135799.034526:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.034535:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.034546:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135799.034570:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277824:0@lo:101: 00000100:00100000:1.0:1789135799.037342:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.037396:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.047514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277824 00000100:00100000:0.0:1789135799.047535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277824 00000100:00100000:0.0:1789135799.047637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789135799.047650:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723277824:12345-0@lo:101: 00010000:00010000:0.0:1789135799.047673:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135799.047722:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f31 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.047762:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.047776:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.047787:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030e00, rc 0) 00000100:00100000:0.0:1789135799.047887:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723277824:12345-0@lo:101: Request processed in 240us (10553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.047894:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789135799.059415:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277824:0@lo:101: 00010000:00010000:0.0:1789135799.059449:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.059463:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.059573:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277952:0@lo:501: 00000100:00100000:0.0:1789135799.059671:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.059736:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.059758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723277952 00000100:00100000:0.0:1789135799.059764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723277952 00000100:00100000:0.0:1789135799.059810:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789135799.059820:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723277952:12345-0@lo:501: 00000100:00100000:0.0:1789135799.060149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723277952:12345-0@lo:501: Request processed in 329us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.060157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789135799.060201:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723277952:0@lo:501: 00000100:00100000:0.0:1789135799.060240:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278080:0@lo:503: 00000100:00100000:0.0:1789135799.060277:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.060292:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.060305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278080 00000100:00100000:0.0:1789135799.060309:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278080 00000100:00100000:0.0:1789135799.060332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789135799.060339:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723278080:12345-0@lo:503: 00000100:00100000:0.0:1789135799.060477:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723278080:12345-0@lo:503: Request processed in 138us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.060484:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789135799.060538:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278080:0@lo:503: 00000100:00100000:1.0:1789135799.074027:0:8025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8025:1876044723278208:0@lo:502: 00000100:00100000:1.0:1789135799.074145:0:8025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.074200:0:8025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.075383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278208 00000100:00100000:0.0:1789135799.075395:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278208 00000100:00100000:0.0:1789135799.075458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789135799.075469:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8025:x1876044723278208:12345-0@lo:502: 00000100:00100000:0.0:1789135799.075790:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8025:x1876044723278208:12345-0@lo:502: Request processed in 321us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.075805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789135799.075869:0:8025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8025:1876044723278208:0@lo:502: 00000100:00100000:0.0:1789135799.075936:0:8025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8025:1876044723278336:0@lo:502: 00000100:00100000:0.0:1789135799.075981:0:8025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.076008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278336 00000100:00100000:0.0:1789135799.076012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278336 00000100:00100000:0.0:1789135799.076035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789135799.076041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8025:x1876044723278336:12345-0@lo:502: 00000100:00100000:0.0:1789135799.076163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8025:x1876044723278336:12345-0@lo:502: Request processed in 121us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.076170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789135799.076197:0:8025:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.076208:0:8025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8025:1876044723278336:0@lo:502: 00000040:00080000:0.0:1789135799.076241:0:8025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789135799.076321:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789135799.076337:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135799.076348:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076359:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135799.076368:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135799.076371:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba04857c800 from 5 10000000:01000000:0.0:1789135799.076374:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135799.076399:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076413:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076423:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.076435:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278464:0@lo:101: 00000100:00100000:0.0:1789135799.076464:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.076477:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.076490:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278464 00000100:00100000:0.0:1789135799.076494:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278464 00000100:00100000:0.0:1789135799.076528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789135799.076534:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723278464:12345-0@lo:101: 00010000:00010000:0.0:1789135799.076543:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135799.076557:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f3f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076594:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f3f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076605:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030c00, rc 0) 00000100:00100000:0.0:1789135799.076631:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723278464:12345-0@lo:101: Request processed in 98us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.076637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789135799.076665:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278464:0@lo:101: 00010000:00010000:0.0:1789135799.076681:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.076690:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.076759:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278592:0@lo:256: 00000100:00100000:0.0:1789135799.076795:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.076809:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.076820:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278592 00000100:00100000:0.0:1789135799.076824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278592 00000100:00100000:0.0:1789135799.076843:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789135799.076850:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723278592:12345-0@lo:256: 20000000:01000000:0.0:1789135799.076863:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789135799.076880:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789135799.076883:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789135799.076955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723278592:12345-0@lo:256: Request processed in 105us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.076963:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789135799.076993:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278592:0@lo:256: 10000000:01000000:0.0:1789135799.077030:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789135799.077035:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077044:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135799.077050:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789135799.077056:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789135799.077059:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135799.077076:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077084:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077091:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.077103:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278720:0@lo:101: 00000100:00100000:0.0:1789135799.077128:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.077140:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.077152:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278720 00000100:00100000:0.0:1789135799.077155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278720 00000100:00100000:0.0:1789135799.077176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789135799.077181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723278720:12345-0@lo:101: 00010000:00010000:0.0:1789135799.077187:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135799.077196:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f4d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077215:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077222:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031a00, rc 0) 00000100:00100000:0.0:1789135799.077246:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723278720:12345-0@lo:101: Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.077258:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789135799.077288:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278720:0@lo:101: 00010000:00010000:0.0:1789135799.077298:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.077307:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.077345:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278848:0@lo:501: 00000100:00100000:0.0:1789135799.077369:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.077381:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.077390:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278848 00000100:00100000:0.0:1789135799.077393:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278848 00000100:00100000:0.0:1789135799.077413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789135799.077420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723278848:12345-0@lo:501: 00000100:00100000:0.0:1789135799.077733:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723278848:12345-0@lo:501: Request processed in 312us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.077741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789135799.077774:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278848:0@lo:501: 00000100:00100000:0.0:1789135799.077801:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278976:0@lo:503: 00000100:00100000:0.0:1789135799.077840:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.077854:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.077866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723278976 00000100:00100000:0.0:1789135799.077870:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723278976 00000100:00100000:0.0:1789135799.077891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789135799.077897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723278976:12345-0@lo:503: 00000100:00100000:1.0:1789135799.098311:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723278976:12345-0@lo:503: Request processed in 20402us (20458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.098326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789135799.098909:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723278976:0@lo:503: 00000100:00100000:0.0:1789135799.101648:0:8027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8027:1876044723279104:0@lo:502: 00000100:00100000:0.0:1789135799.101756:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.101795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279104 00000100:00100000:0.0:1789135799.101801:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279104 00000100:00100000:0.0:1789135799.101841:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135799.101850:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8027:x1876044723279104:12345-0@lo:502: 00000100:00100000:0.0:1789135799.102143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8027:x1876044723279104:12345-0@lo:502: Request processed in 293us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.102151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135799.102200:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.102661:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8027:1876044723279104:0@lo:502: 00000020:01000000:0.0:1789135799.102691:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789135799.102722:0:8027:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789135799.102730:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135799.102733:0:8027:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789135799.102737:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789135799.102740:0:8027:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.141@tcp to nid 0x20000c0a8cc8d (192.168.204.141@tcp) 00000020:01000000:0.0:1789135799.102761:0:8027:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789135799.102763:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789135799.102777:0:8027:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ba04918b490) 00000020:00000080:0.0:1789135799.102801:0:8027:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789135799.102806:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789135799.102875:0:8027:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789135799.102880:0:8027:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789135799.102886:0:8027:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf95f62 00010000:00080000:0.0:1789135799.102928:0:8027:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba0491ee800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:0.0:1789135799.103160:0:8027:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789135799.106358:0:8027:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789135799.106381:0:8027:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789135799.119103:0:8027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135799.119444:0:8027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135799.119497:0:8027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789135799.119570:0:8027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789135799.120231:0:8029:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135799.120236:0:8029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789135799.121096:0:8027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135799.121108:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789135799.121139:0:8027:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789135799.121163:0:8027:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf95f69 00000100:00080000:2.0:1789135799.121174:0:8027:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135799.121180:0:8027:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba0491ee800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789135799.121297:0:8027:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c3983c0 x1876044723279232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135799.121328:0:8027:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789135799.121379:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135799.121383:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135799.121385:0:8027:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789135799.121388:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135799.121392:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135799.121394:0:8027:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135799.121397:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135799.121399:0:8027:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789135799.121429:0:8027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8027:1876044723279360:0@lo:502: 00000100:00100000:2.0:1789135799.121524:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135799.121569:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.122258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279360 00000100:00100000:1.0:1789135799.122265:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279360 00000100:00100000:1.0:1789135799.122314:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789135799.122324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8027:x1876044723279360:12345-0@lo:502: 00000100:00100000:1.0:1789135799.122618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8027:x1876044723279360:12345-0@lo:502: Request processed in 294us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.122626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789135799.122749:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8027:1876044723279360:0@lo:502: 00000020:01000000:1.0:1789135799.122781:0:8027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135799.122787:0:8027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135799.122789:0:8027:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135799.122793:0:8027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789135799.123796:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723279232:0@lo:8: 00000100:00100000:0.0:1789135799.123852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789135799.123960:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789135799.123979:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789135799.123988:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.123999:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135799.124020:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789135799.124023:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ba0592cced8 from 1 10000000:01000000:0.0:1789135799.124026:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135799.124048:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.124056:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.124064:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.124078:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723280000:0@lo:101: 00000100:00100000:0.0:1789135799.124118:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.124133:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.124160:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723279488:0@lo:400: 00000100:00100000:0.0:1789135799.124187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135799.124487:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135799.124532:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135799.124540:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723279616:0@lo:400: 00000100:00100000:0.0:1789135799.124565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.124603:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723279744:0@lo:400: 00000100:00100000:0.0:1789135799.124631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.124651:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135799.124657:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723279872:0@lo:400: 00000100:00100000:0.0:1789135799.124681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.124736:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280000 00000100:00100000:0.0:1789135799.124743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280000 00000100:00100000:0.0:1789135799.124783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789135799.124791:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723280000:12345-0@lo:101: 00010000:00010000:0.0:1789135799.124803:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135799.124815:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95f70 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.124836:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.124846:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.124855:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031000, rc 0) 00000100:00100000:0.0:1789135799.124889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723280000:12345-0@lo:101: Request processed in 99us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.124902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789135799.124932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279488 00000100:00100000:0.0:1789135799.124935:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279488 00000100:00100000:0.0:1789135799.124952:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279616 00000100:00100000:0.0:1789135799.124954:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279616 00000100:00100000:0.0:1789135799.124972:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279872 00000100:00100000:0.0:1789135799.124974:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279872 00000100:00100000:0.0:1789135799.124986:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135799.124992:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723279488:12345-0@lo:400: 00000100:00100000:2.0:1789135799.125113:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279232 00000100:00100000:2.0:1789135799.125117:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279232 00000100:00100000:2.0:1789135799.125138:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723279744 00000100:00100000:2.0:1789135799.125141:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723279744 00000100:00100000:2.0:1789135799.125168:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135799.125175:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723279744:12345-0@lo:400: 00000100:00100000:2.0:1789135799.125431:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723279744:12345-0@lo:400: Request processed in 256us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135799.125439:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135799.125454:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135799.125458:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1876044723279232:12345-0@lo:8: 00010000:00080000:2.0:1789135799.125480:0:6700:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1789135799.125516:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf95f7e 00002000:00100000:2.0:1789135799.125528:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b9f463a6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789135799.125532:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789135799.125535:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789135799.125657:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789135799.125848:0:6700:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135799.125873:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135799.125921:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876044723279232:12345-0@lo:8: Request processed in 460us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135799.125928:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135799.126036:0:5852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789135799.126045:0:5852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789135799.127449:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723279488:12345-0@lo:400: Request processed in 2451us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.127459:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135799.127487:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135799.127496:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723279616:12345-0@lo:400: 00000100:00100000:0.0:1789135799.127539:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723279616:12345-0@lo:400: Request processed in 46us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.127545:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135799.127560:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135799.127567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723279872:12345-0@lo:400: 00000100:00100000:0.0:1789135799.127594:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723279872:12345-0@lo:400: Request processed in 29us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.127599:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789135799.127626:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135799.127632:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135799.127667:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c3983c0 x1876044723279232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.127678:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135799.127695:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789135799.127718:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789135799.127724:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789135799.127727:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ee800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789135799.127736:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789135799.127741:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723279232:0@lo:8: 00010000:00080000:0.0:1789135799.127777:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a9680 x1876044723279872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.127788:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723279872:0@lo:400: 00010000:00080000:0.0:1789135799.127801:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593ab0c0 x1876044723279744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.127809:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723279744:0@lo:400: 00010000:00080000:0.0:1789135799.127837:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a8000 x1876044723279616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.127845:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723279616:0@lo:400: 00010000:00080000:0.0:1789135799.127856:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a92c0 x1876044723279488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.127863:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723279488:0@lo:400: 00000100:00100000:0.0:1789135799.127887:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723280000:0@lo:101: 00010000:00010000:0.0:1789135799.127909:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135799.127922:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135799.127997:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723280128:0@lo:501: 00000100:00100000:0.0:1789135799.128032:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.128062:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f469d10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135799.128523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280128 00000100:00100000:1.0:1789135799.128530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280128 00000100:00100000:1.0:1789135799.128568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789135799.128576:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723280128:12345-0@lo:501: 00000100:00100000:1.0:1789135799.128816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723280128:12345-0@lo:501: Request processed in 240us (783us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135799.128823:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789135799.128861:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723280128:0@lo:501: 10000000:01000000:1.0:1789135799.128891:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789135799.128900:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135799.128910:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135799.129233:0:8029:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789135799.129384:0:8029:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273003682767ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789135799.223396:0:8030:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789135799.223431:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280384:0@lo:7: 00000100:00100000:0.0:1789135799.223512:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.223568:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0581863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.223600:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280384 00000100:00100000:0.0:1789135799.223606:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280384 00000100:00100000:0.0:1789135799.223675:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135799.223683:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8030:x1876044723280384:12345-0@lo:7: 00000100:00100000:1.0:1789135799.225441:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723280256:0@lo:13: 00000100:00100000:1.0:1789135799.225545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.225644:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280256 00000100:00100000:1.0:1789135799.225653:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280256 00000100:00100000:1.0:1789135799.225697:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135799.225721:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723280256:12345-0@lo:13: 00002000:00000024:1.0:1789135799.225750:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789135799.225796:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723280256:12345-0@lo:13: Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135799.225803:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789135799.225846:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a92c0 x1876044723280256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135799.225864:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723280256:0@lo:13: 00000100:00080000:1.0:1789135799.227753:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789135799.231595:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789135799.231604:0:6700:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789135799.231721:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8030:x1876044723280384:12345-0@lo:7: Request processed in 8015us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.231732:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789135799.231792:0:8030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a8000 x1876044723280384/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135815 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.231807:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280384:0@lo:7: 00000004:00080000:0.0:1789135799.231821:0:8030:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789135799.231859:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280512:0@lo:5: 00000100:00100000:0.0:1789135799.231893:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.231925:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0581863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.231943:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280512 00000100:00100000:0.0:1789135799.231949:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280512 00000100:00100000:0.0:1789135799.231989:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135799.231997:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8030:x1876044723280512:12345-0@lo:5: 00002000:00080000:0.0:1789135799.232020:0:6698:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789135799.232024:0:6698:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789135799.239588:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8030:x1876044723280512:12345-0@lo:5: Request processed in 6198us (6300us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789135799.239611:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789135799.239739:0:8030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593a8000 x1876044723280512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135815 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.239761:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280512:0@lo:5: 00000004:00080000:0.0:1789135799.239780:0:8030:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789135799.239848:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593ab840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280640:0@lo:700: 00000100:00100000:0.0:1789135799.239914:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.240023:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0581863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135799.243895:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280640 00000100:00100000:3.0:1789135799.243912:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280640 00000100:00100000:3.0:1789135799.243983:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135799.243994:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8030:x1876044723280640:12345-0@lo:700: 00000100:00100000:3.0:1789135799.244062:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1bb840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1876044723280768:0@lo:700: 00000100:00100000:3.0:1789135799.244145:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135799.244179:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.250005:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280768 00000100:00100000:0.0:1789135799.250024:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280768 00000100:00100000:0.0:1789135799.250090:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135799.250101:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1876044723280768:12345-0@lo:700: 00000004:00080000:2.0:1789135799.290513:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789135799.335592:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789135799.344993:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6706:x1876044723280768:12345-0@lo:700: Request processed in 94883us (100837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.345009:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789135799.345071:0:6706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba07c1bb840 x1876044723280768/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135815 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.345085:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1bb840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6706:1876044723280768:0@lo:700: 40000000:02000000:0.0:1789135799.345113:0:6706:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789135799.539436:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8030:x1876044723280640:12345-0@lo:700: Request processed in 295431us (299508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135799.539454:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1789135799.539604:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789135799.539631:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1789135799.539833:0:8030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593ab840 x1876044723280640/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135815 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135799.539854:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593ab840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280640:0@lo:700: 00000004:02000040:0.0:1789135799.565170:0:8030:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789135799.570605:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1bad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280896:0@lo:5: 00000100:00100000:3.0:1789135799.571115:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135799.571589:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07400ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135799.571690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723280896 00000100:00100000:0.0:1789135799.571753:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723280896 00000100:00100000:0.0:1789135799.571870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135799.571881:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8030:x1876044723280896:12345-0@lo:5: 00002000:00080000:3.0:1789135799.580212:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789135799.580235:0:6698:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789135799.588579:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8030:x1876044723280896:12345-0@lo:5: Request processed in 16690us (17455us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789135799.588596:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789135799.592576:0:8030:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba07c1bad00 x1876044723280896/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135815 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135799.592593:0:8030:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789135799.592672:0:8030:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ba07c1bad00 x1876044723280896/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135815 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135799.592685:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1bad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8030:1876044723280896:0@lo:5: 00000004:00080000:1.0:1789135799.592715:0:8030:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789135800.014532:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135800.014564:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723281024:0@lo:13: 00000100:00100000:1.0:1789135800.014668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135800.014881:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281024 00000100:00100000:0.0:1789135800.014889:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281024 00000100:00100000:0.0:1789135800.014933:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135800.014943:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723281024:12345-0@lo:13: 00002000:00000024:0.0:1789135800.014979:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135800.015025:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723281024:12345-0@lo:13: Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.015032:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789135800.015074:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0593ab840 x1876044723281024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135800.015093:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723281024:0@lo:13: 00010000:00010000:0.0:1789135800.141737:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135801.167695:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135802.205084:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135803.212836:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135804.239352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135804.339796:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789135804.621131:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0497a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723281152:0@lo:13: 00000100:00100000:1.0:1789135804.621221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.621309:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281152 00000100:00100000:1.0:1789135804.621315:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281152 00000100:00100000:1.0:1789135804.621369:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135804.621378:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723281152:12345-0@lo:13: 00002000:00000024:1.0:1789135804.621427:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135804.621476:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723281152:12345-0@lo:13: Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135804.621483:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789135804.621502:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789135804.621543:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0497a83c0 x1876044723281152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135804.621553:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789135804.621577:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0497a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723281152:0@lo:13: 00000100:00100000:1.0:1789135804.623120:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723281664:0@lo:400: 00000100:00100000:1.0:1789135804.623179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.623208:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135804.623214:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0497a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723281280:0@lo:400: 00000100:00100000:1.0:1789135804.623242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.623265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723281792:0@lo:400: 00000100:00100000:1.0:1789135804.623289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.623315:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281280 00000100:00100000:1.0:1789135804.623321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281280 00000100:00100000:1.0:1789135804.623356:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789135804.623364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723281280:12345-0@lo:400: 00000100:00100000:1.0:1789135804.623418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723281280:12345-0@lo:400: Request processed in 55us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135804.623426:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789135804.623480:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0497a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723281280:0@lo:400: 00000100:00100000:2.0:1789135804.624352:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723281536:0@lo:400: 00000100:00100000:2.0:1789135804.624411:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135804.624446:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135804.624461:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723281408:0@lo:400: 00000100:00100000:2.0:1789135804.624485:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135804.624526:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281792 00000100:00100000:2.0:1789135804.624531:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281792 00000100:00100000:2.0:1789135804.624572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281536 00000100:00100000:2.0:1789135804.624575:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281536 00000100:00100000:2.0:1789135804.624585:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281408 00000100:00100000:2.0:1789135804.624586:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281408 00000100:00100000:2.0:1789135804.624744:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789135804.624758:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723281792:12345-0@lo:400: 00000100:00100000:2.0:1789135804.624818:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723281792:12345-0@lo:400: Request processed in 63us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.624824:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789135804.624843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789135804.624848:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723281536:12345-0@lo:400: 00000100:00100000:2.0:1789135804.624893:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723281536:12345-0@lo:400: Request processed in 44us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.624899:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789135804.624910:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135804.624916:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723281408:12345-0@lo:400: 00000100:00100000:2.0:1789135804.624942:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723281408:12345-0@lo:400: Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.624948:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789135804.624975:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789135804.625007:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074302d00 x1876044723281408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135804.625021:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723281408:0@lo:400: 00010000:00080000:2.0:1789135804.625044:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074302580 x1876044723281536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135804.625052:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723281536:0@lo:400: 00010000:00080000:2.0:1789135804.625171:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074302940 x1876044723281792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135804.625180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723281792:0@lo:400: 00000100:00100000:0.0:1789135804.625835:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281664 00000100:00100000:0.0:1789135804.625842:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281664 00000100:00100000:0.0:1789135804.625903:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135804.625912:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723281664:12345-0@lo:400: 00000100:00100000:0.0:1789135804.625978:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723281664:12345-0@lo:400: Request processed in 68us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135804.625984:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789135804.626008:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135804.626030:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074301a40 x1876044723281664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135804.626042:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074301a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723281664:0@lo:400: 00000100:00100000:3.0:1789135805.037875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135805.038933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695994496 00000100:00100000:1.0:1789135805.038950:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695994496 00000100:00100000:1.0:1789135805.039013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:1.0:1789135805.039025:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1876044695994496:12345-192.168.204.41@tcp:250: 00010000:00080000:1.0:1789135805.039071:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from e1c2678a-1780-480c-8bd9-51a1945fdd3f@192.168.204.41@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1789135805.039119:0:5844:0:(genops.c:1385:class_connect()) connect: client e1c2678a-1780-480c-8bd9-51a1945fdd3f, cookie 0x38eb79866bf95f85 00000100:00080000:1.0:1789135805.046410:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135805.046522:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+5:2362:x1876044695994496:12345-192.168.204.41@tcp:250: Request processed in 7483us (8648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.046535:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:1.0:1789135805.067520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135805.068311:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695994624 00000100:00100000:2.0:1789135805.068324:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695994624 00000100:00100000:2.0:1789135805.068405:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00100000:2.0:1789135805.068417:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+5:5595:x1876044695994624:12345-192.168.204.41@tcp:101: 00010000:00010000:2.0:1789135805.068441:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135805.068467:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe08 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.068520:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.068542:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.068556:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e000, rc 0) 00000100:00100000:2.0:1789135805.068648:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+6:5595:x1876044695994624:12345-192.168.204.41@tcp:101: Request processed in 233us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.068656:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00100000:1.0:1789135805.073899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135805.074124:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695994752 00000100:00100000:2.0:1789135805.074146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695994752 00000100:00100000:2.0:1789135805.074241:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 115 00000100:00100000:2.0:1789135805.074251:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+6:5595:x1876044695994752:12345-192.168.204.41@tcp:501: 00000100:00100000:2.0:1789135805.074637:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+6:5595:x1876044695994752:12345-192.168.204.41@tcp:501: Request processed in 386us (756us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135805.074646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 115 00000100:00100000:1.0:1789135805.082692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.084651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695994880 00000100:00100000:3.0:1789135805.084671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695994880 00000100:00100000:3.0:1789135805.084863:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 116 00000100:00100000:3.0:1789135805.084876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+6:5595:x1876044695994880:12345-192.168.204.41@tcp:101: 00010000:00010000:3.0:1789135805.084903:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135805.084942:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe0f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.084979:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.084993:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.085004:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc000, rc 0) 00000100:00100000:3.0:1789135805.085092:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+7:5595:x1876044695994880:12345-192.168.204.41@tcp:101: Request processed in 219us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.085100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 116 00000100:00100000:3.0:1789135805.103896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.103943:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995008 00000100:00100000:3.0:1789135805.103952:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995008 00000100:00100000:3.0:1789135805.104005:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 117 00000100:00100000:3.0:1789135805.104017:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+7:5595:x1876044695995008:12345-192.168.204.41@tcp:501: 00000100:00100000:3.0:1789135805.104839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5595:x1876044695995008:12345-192.168.204.41@tcp:501: Request processed in 822us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.104851:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 117 00000100:00100000:1.0:1789135805.112544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.114082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995136 00000100:00100000:3.0:1789135805.114102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995136 00000100:00100000:1.0:1789135805.114370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:1.0:1789135805.114416:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5595:x1876044695995136:12345-192.168.204.41@tcp:503: 00000100:00100000:1.0:1789135805.115272:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5595:x1876044695995136:12345-192.168.204.41@tcp:503: Request processed in 883us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.115285:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:1.0:1789135805.118690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135805.119519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995264 00000100:00100000:2.0:1789135805.119540:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995264 00000100:00100000:2.0:1789135805.119642:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:2.0:1789135805.119655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5614:x1876044695995264:12345-192.168.204.41@tcp:502: 00000100:00100000:2.0:1789135805.120253:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5614:x1876044695995264:12345-192.168.204.41@tcp:502: Request processed in 599us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.120265:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:2.0:1789135805.141563:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135805.141609:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723281920:0@lo:13: 00000100:00100000:2.0:1789135805.141931:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.142551:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723281920 00000100:00100000:0.0:1789135805.142568:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723281920 00000100:00100000:0.0:1789135805.144177:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135805.144205:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723281920:12345-0@lo:13: 00002000:00000024:0.0:1789135805.144277:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135805.144676:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723281920:12345-0@lo:13: Request processed in 483us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.144685:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789135805.147934:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074300f00 x1876044723281920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135805.147995:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723281920:0@lo:13: 00000100:00100000:3.0:1789135805.160139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135805.160422:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995392 00000100:00100000:1.0:1789135805.160436:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995392 00000100:00100000:1.0:1789135805.160540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:1.0:1789135805.160554:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5614:x1876044695995392:12345-192.168.204.41@tcp:502: 00000100:00100000:0.0:1789135805.161264:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5614:x1876044695995392:12345-192.168.204.41@tcp:502: Request processed in 706us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.161280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:1.0:1789135805.164842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.165267:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995520 00000100:00100000:3.0:1789135805.165281:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995520 00000100:00100000:3.0:1789135805.165347:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:3.0:1789135805.165362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5595:x1876044695995520:12345-192.168.204.41@tcp:101: 00010000:00010000:3.0:1789135805.165404:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135805.165435:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cca00/0x38eb79866bf95f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.165484:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cca00/0x38eb79866bf95f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe39 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.165499:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cca00/0x38eb79866bf95f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe39 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.165522:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cca00, rc 0) 00000100:00100000:3.0:1789135805.165621:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5595:x1876044695995520:12345-192.168.204.41@tcp:101: Request processed in 265us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.165631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:1.0:1789135805.171651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135805.172067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995648 00000100:00100000:0.0:1789135805.172084:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995648 00000100:00100000:0.0:1789135805.172182:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 122 00000100:00100000:0.0:1789135805.172196:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5595:x1876044695995648:12345-192.168.204.41@tcp:256: 20000000:01000000:0.0:1789135805.172241:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789135805.172280:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789135805.172285:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789135805.172298:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789135805.172301:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789135805.191473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5595:x1876044695995648:12345-192.168.204.41@tcp:256: Request processed in 19257us (19816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.191494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 122 00000100:00100000:2.0:1789135805.198624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.198750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995776 00000100:00100000:3.0:1789135805.198770:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995776 00000100:00100000:3.0:1789135805.198868:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:3.0:1789135805.198882:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5595:x1876044695995776:12345-192.168.204.41@tcp:101: 00010000:00010000:3.0:1789135805.198909:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135805.198936:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.199004:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.199018:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.199031:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc800, rc 0) 00000100:00100000:3.0:1789135805.199121:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5595:x1876044695995776:12345-192.168.204.41@tcp:101: Request processed in 243us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.199129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:1.0:1789135805.206087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.206181:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695995904 00000100:00100000:3.0:1789135805.206200:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695995904 00000100:00100000:3.0:1789135805.206284:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00100000:3.0:1789135805.206296:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5595:x1876044695995904:12345-192.168.204.41@tcp:501: 00000100:00100000:3.0:1789135805.210064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5595:x1876044695995904:12345-192.168.204.41@tcp:501: Request processed in 3748us (4240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.210087:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00100000:0.0:1789135805.232372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.232483:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996032 00000100:00100000:3.0:1789135805.232497:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996032 00000100:00100000:3.0:1789135805.232583:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 125 00000100:00100000:3.0:1789135805.232595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5595:x1876044695996032:12345-192.168.204.41@tcp:503: 00000100:00100000:3.0:1789135805.233207:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5595:x1876044695996032:12345-192.168.204.41@tcp:503: Request processed in 609us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.233218:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 125 00000100:00100000:1.0:1789135805.239349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135805.239467:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996160 00000100:00100000:3.0:1789135805.239512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996160 00000100:00100000:3.0:1789135805.239600:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 126 00000100:00100000:3.0:1789135805.239616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5619:x1876044695996160:12345-192.168.204.41@tcp:502: 00000100:00100000:3.0:1789135805.240042:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5619:x1876044695996160:12345-192.168.204.41@tcp:502: Request processed in 427us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.240053:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 126 00000100:00100000:1.0:1789135805.244513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135805.244742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996288 00000100:00100000:0.0:1789135805.244759:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996288 00000100:00100000:0.0:1789135805.244830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 127 00000100:00100000:0.0:1789135805.244842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5619:x1876044695996288:12345-192.168.204.41@tcp:502: 00000100:00100000:0.0:1789135805.248713:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5619:x1876044695996288:12345-192.168.204.41@tcp:502: Request processed in 2663us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.248733:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 127 00000100:00100000:0.0:1789135805.253600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135805.253751:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996416 00000100:00100000:2.0:1789135805.253763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996416 00000100:00100000:2.0:1789135805.253823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:2.0:1789135805.253834:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2362:x1876044695996416:12345-192.168.204.41@tcp:38: 00010000:00080000:2.0:1789135805.253881:0:5852:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:2.0:1789135805.253955:0:5852:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf95fa8 00000004:00100000:2.0:1789135805.254018:0:5852:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789135805.254028:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789135805.261300:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789135805.299464:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135805.299593:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044695996416:12345-192.168.204.41@tcp:38: Request processed in 45758us (46012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.299607:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00010000:00010000:0.0:1789135806.284962:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135806.305300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135806.305355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135806.308880:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996672 00000100:00100000:0.0:1789135806.308907:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996672 00000100:00100000:0.0:1789135806.309157:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996544 00000100:00100000:0.0:1789135806.309161:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996544 00000100:00100000:0.0:1789135806.309198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:0.0:1789135806.309209:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:5595:x1876044695996672:12345-192.168.204.41@tcp:41: 00000004:00000024:0.0:1789135806.309295:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789135806.309769:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:5595:x1876044695996672:12345-192.168.204.41@tcp:41: Request processed in 559us (4486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.309779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:0.0:1789135806.309808:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:0.0:1789135806.309819:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044695996544:12345-192.168.204.41@tcp:41: 00000004:00000024:0.0:1789135806.309860:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789135806.309892:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044695996544:12345-192.168.204.41@tcp:41: Request processed in 77us (4536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.309900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00080000:2.0:1789135806.314860:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135806.320197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135806.320297:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996800 00000100:00100000:3.0:1789135806.320314:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996800 00000100:00100000:3.0:1789135806.320417:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789135806.320430:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5595:x1876044695996800:12345-192.168.204.41@tcp:40: 00000100:00100000:3.0:1789135806.321945:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5595:x1876044695996800:12345-192.168.204.41@tcp:40: Request processed in 1501us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.321961:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:0.0:1789135806.329216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135806.329282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135806.329743:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695996928 00000100:00100000:3.0:1789135806.329758:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695996928 00000100:00100000:3.0:1789135806.329828:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:3.0:1789135806.329839:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1876044695996928:12345-192.168.204.41@tcp:8: 00010000:00080000:3.0:1789135806.329886:0:6698:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:3.0:1789135806.329948:0:6698:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf95faf 00002000:00100000:3.0:1789135806.329966:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8b9f46d43000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135806.329983:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135806.330890:0:6698:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789135806.330946:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135806.331061:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044695996928:12345-192.168.204.41@tcp:8: Request processed in 1220us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.331074:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789135806.332192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997184 00000100:00100000:1.0:1789135806.332205:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997184 00000100:00100000:1.0:1789135806.332275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 128 00000100:00100000:1.0:1789135806.332286:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044695997184:12345-192.168.204.41@tcp:400: 00000100:00100000:1.0:1789135806.332383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044695997184:12345-192.168.204.41@tcp:400: Request processed in 99us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.332390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 128 00000100:00100000:1.0:1789135806.333620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135806.333956:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997056 00000100:00100000:0.0:1789135806.333968:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997056 00000100:00100000:0.0:1789135806.334030:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:0.0:1789135806.334040:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1876044695997056:12345-192.168.204.41@tcp:8: 00010000:00080000:0.0:1789135806.334083:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:0.0:1789135806.334134:0:6697:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf95fb6 00002000:00100000:0.0:1789135806.334162:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8ba0491eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789135806.334195:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789135806.334880:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789135806.334941:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135806.335033:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044695997056:12345-192.168.204.41@tcp:8: Request processed in 992us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.335042:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:0.0:1789135806.339848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135806.339988:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997312 00000100:00100000:2.0:1789135806.340007:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997312 00000100:00100000:0.0:1789135806.340210:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:0.0:1789135806.340229:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5595:x1876044695997312:12345-192.168.204.41@tcp:33: 00000004:00080000:0.0:1789135806.386863:0:5854:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46505us 00000004:00200000:0.0:1789135806.407676:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789135806.407953:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5595:x1876044695997312:12345-192.168.204.41@tcp:33: Request processed in 67721us (68118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.407967:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:2.0:1789135806.629105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135806.629352:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997440 00000100:00100000:3.0:1789135806.629375:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997440 00000100:00100000:3.0:1789135806.629473:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:3.0:1789135806.629488:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5636:x1876044695997440:12345-192.168.204.41@tcp:101: 00010000:00010000:3.0:1789135806.629535:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.629798:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf95fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe6a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630049:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630067:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630089:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135806.630411:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789135806.630415:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135806.630501:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630540:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf95fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe6a expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630562:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe6a expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.630571:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:3.0:1789135806.630575:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135806.630586:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135806.630677:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:5636:x1876044695997440:12345-192.168.204.41@tcp:101: Request processed in 1191us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.630687:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00010000:00010000:1.0:1789135807.310198:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135808.254179:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00010000:00010000:0.0:1789135808.333186:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135808.810963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135808.811052:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997568 00000100:00100000:3.0:1789135808.811062:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997568 00000100:00100000:3.0:1789135808.811138:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:3.0:1789135808.811148:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:5688:x1876044695997568:12345-192.168.204.41@tcp:41: 00000004:00000024:3.0:1789135808.811195:0:8031:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789135808.811282:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:5688:x1876044695997568:12345-192.168.204.41@tcp:41: Request processed in 135us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135808.811290:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00080000:2.0:1789135808.815587:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135808.827381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135808.828975:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997696 00000100:00100000:1.0:1789135808.828992:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997696 00000100:00100000:1.0:1789135808.829089:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:1.0:1789135808.829101:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:5688:x1876044695997696:12345-192.168.204.41@tcp:13: 00002000:00000024:1.0:1789135808.829145:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135808.829221:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:5688:x1876044695997696:12345-192.168.204.41@tcp:13: Request processed in 123us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135808.829230:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00080000:2.0:1789135808.829404:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135808.848139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135808.848252:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997824 00000100:00100000:0.0:1789135808.848268:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997824 00000100:00100000:0.0:1789135808.848398:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:0.0:1789135808.848412:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5688:x1876044695997824:12345-192.168.204.41@tcp:13: 00002000:00000024:0.0:1789135808.848483:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789135808.848697:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135808.849327:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:5688:x1876044695997824:12345-192.168.204.41@tcp:13: Request processed in 904us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135808.849338:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00010000:00010000:1.0:1789135809.357434:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135809.743887:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723282048:0@lo:13: 00000100:00100000:2.0:1789135809.743921:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723282176:0@lo:400: 00000100:00100000:2.0:1789135809.746053:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.746153:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723282560:0@lo:400: 00000100:00100000:2.0:1789135809.746201:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.746233:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135809.746241:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723282432:0@lo:400: 00000100:00100000:2.0:1789135809.746281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.746346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282176 00000100:00100000:2.0:1789135809.746354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282176 00000100:00100000:2.0:1789135809.746407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789135809.746417:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723282176:12345-0@lo:400: 00000100:00100000:2.0:1789135809.746550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723282176:12345-0@lo:400: Request processed in 133us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.746558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789135809.746579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.746596:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282560 00000100:00100000:2.0:1789135809.746601:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282560 00000100:00100000:2.0:1789135809.746638:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135809.746657:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723282560:12345-0@lo:400: 00000100:00100000:1.0:1789135809.746695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723282688:0@lo:400: 00000100:00100000:2.0:1789135809.746696:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723282560:12345-0@lo:400: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135809.746744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.746755:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135809.746773:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00080000:2.0:1789135809.746778:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135809.746784:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723282304:0@lo:400: 00000100:00100000:1.0:1789135809.746808:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135809.746835:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723282816:0@lo:400: 00000100:00100000:1.0:1789135809.746858:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135809.746889:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282432 00000100:00100000:1.0:1789135809.746893:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282432 00000100:00100000:1.0:1789135809.746930:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282688 00000100:00100000:1.0:1789135809.746933:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282688 00000100:00100000:1.0:1789135809.746948:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282304 00000100:00100000:1.0:1789135809.746950:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282304 00000100:00100000:1.0:1789135809.746963:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135809.746969:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723282432:12345-0@lo:400: 00000100:00100000:0.0:1789135809.747024:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723282176:0@lo:400: 00000100:00100000:2.0:1789135809.747050:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135809.747071:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723282688:12345-0@lo:400: 00000100:00100000:1.0:1789135809.749756:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723282432:12345-0@lo:400: Request processed in 2773us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135809.749776:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789135809.749823:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f20780 x1876044723282560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135809.749834:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135809.749851:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723282560:0@lo:400: 00000100:00100000:1.0:1789135809.749863:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723282304:12345-0@lo:400: 00000100:00100000:0.0:1789135809.749903:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723282432:0@lo:400: 00000100:00100000:1.0:1789135809.749976:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723282304:12345-0@lo:400: Request processed in 129us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135809.749983:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135809.750015:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282048 00000100:00100000:1.0:1789135809.750023:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282048 00000100:00100000:0.0:1789135809.750040:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723282304:0@lo:400: 00000100:00100000:1.0:1789135809.751848:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135809.751868:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723282048:12345-0@lo:13: 00002000:00000024:1.0:1789135809.751904:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135809.752051:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723282048:12345-0@lo:13: Request processed in 190us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135809.752069:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135809.752119:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282816 00000100:00100000:1.0:1789135809.752128:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282816 00000100:00100000:1.0:1789135809.752169:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135809.752175:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723282816:12345-0@lo:400: 00000100:00100000:1.0:1789135809.752211:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723282816:12345-0@lo:400: Request processed in 36us (5352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135809.752217:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789135809.752240:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135809.752246:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135809.752282:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f230c0 x1876044723282816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135809.752309:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723282816:0@lo:400: 00010000:00080000:1.0:1789135809.752323:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074301e00 x1876044723282048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135809.752337:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723282048:0@lo:13: 00000100:00100000:2.0:1789135809.754404:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723282688:12345-0@lo:400: Request processed in 7333us (7647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135809.754477:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723282688:0@lo:400: 00000100:00100000:2.0:1789135809.754493:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135810.255460:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135810.255493:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723282944:0@lo:13: 00000100:00100000:1.0:1789135810.255581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.255785:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723282944 00000100:00100000:3.0:1789135810.255804:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723282944 00000100:00100000:3.0:1789135810.255891:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135810.255903:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723282944:12345-0@lo:13: 00002000:00000024:3.0:1789135810.255968:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135810.256098:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723282944:12345-0@lo:13: Request processed in 196us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.256108:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789135810.258638:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074301e00 x1876044723282944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135810.258674:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723282944:0@lo:13: 00010000:00010000:3.0:1789135810.386666:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135810.834240:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000001:00100000:1.0:1789135810.843362:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00010000:00010000:0.0:1789135811.405208:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135811.442439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135811.442497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135811.442530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135811.442556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135811.442590:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998336 00000100:00100000:1.0:1789135811.442612:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998336 00000100:00100000:1.0:1789135811.442672:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998208 00000100:00100000:1.0:1789135811.442676:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998208 00000100:00100000:1.0:1789135811.442726:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:1.0:1789135811.442737:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044695998336:12345-192.168.204.41@tcp:400: 00000100:00100000:1.0:1789135811.442839:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044695998336:12345-192.168.204.41@tcp:400: Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135811.442848:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:1.0:1789135811.442871:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789135811.442878:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044695998208:12345-192.168.204.41@tcp:400: 00000100:00100000:1.0:1789135811.442903:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044695998208:12345-192.168.204.41@tcp:400: Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135811.442909:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789135811.442929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695997952 00000100:00100000:1.0:1789135811.442933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695997952 00000100:00100000:1.0:1789135811.442961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 130 00000100:00100000:1.0:1789135811.442968:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2366:x1876044695997952:12345-192.168.204.41@tcp:400: 00000100:00100000:1.0:1789135811.442994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2366:x1876044695997952:12345-192.168.204.41@tcp:400: Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135811.443001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 130 00000100:00080000:1.0:1789135811.443035:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135811.443057:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135811.444828:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998080 00000100:00100000:3.0:1789135811.444847:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998080 00000100:00100000:3.0:1789135811.444950:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:3.0:1789135811.444962:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044695998080:12345-192.168.204.41@tcp:400: 00000100:00100000:3.0:1789135811.445071:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044695998080:12345-192.168.204.41@tcp:400: Request processed in 110us (2643us total) trans 0 rc 0/0 00000100:00080000:1.0:1789135811.445730:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135811.445820:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000001:02000400:2.0:1789135812.093401:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789135812.429027:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135813.458382:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135814.477323:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135814.861364:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723283200:0@lo:400: 00000100:00100000:0.0:1789135814.861494:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135814.861598:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723283712:0@lo:400: 00000100:00100000:0.0:1789135814.861638:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135814.861685:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135814.861694:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723283328:0@lo:400: 00000100:00100000:0.0:1789135814.861816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135814.861888:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283200 00000100:00100000:0.0:1789135814.861899:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283200 00000100:00100000:0.0:1789135814.861956:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283328 00000100:00100000:0.0:1789135814.861960:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283328 00000100:00100000:0.0:1789135814.862000:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135814.862009:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723283200:12345-0@lo:400: 00000100:00100000:0.0:1789135814.862087:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723283200:12345-0@lo:400: Request processed in 77us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135814.862097:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135814.862119:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135814.862125:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723283328:12345-0@lo:400: 00000100:00100000:0.0:1789135814.862156:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723283328:12345-0@lo:400: Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135814.862163:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135814.862216:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723283328:0@lo:400: 00000100:00100000:0.0:1789135814.862230:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723283200:0@lo:400: 00000100:00100000:1.0:1789135814.862373:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723283072:0@lo:400: 00000100:00100000:1.0:1789135814.862432:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135814.862479:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283072 00000100:00100000:1.0:1789135814.862482:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723283584:0@lo:400: 00000100:00100000:2.0:1789135814.862495:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283072 00000100:00100000:1.0:1789135814.862524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135814.862564:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135814.862572:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723283456:0@lo:400: 00000100:00100000:1.0:1789135814.862603:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135814.862638:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789135814.862654:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723283072:12345-0@lo:400: 00000100:00100000:1.0:1789135814.862656:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283584 00000100:00100000:1.0:1789135814.862664:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283584 00000100:00100000:1.0:1789135814.862726:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135814.862737:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723283584:12345-0@lo:400: 00000100:00100000:0.0:1789135814.865144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135814.865172:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723283840:0@lo:13: 00000100:00100000:1.0:1789135814.872637:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723283584:12345-0@lo:400: Request processed in 9880us (10092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135814.872668:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135814.872761:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283712 00000100:00100000:1.0:1789135814.872778:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283712 00000100:00100000:1.0:1789135814.872861:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283456 00000100:00100000:1.0:1789135814.872866:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283456 00000100:00100000:1.0:1789135814.872891:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135814.872902:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723283712:12345-0@lo:400: 00000100:00100000:1.0:1789135814.873014:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723283712:12345-0@lo:400: Request processed in 116us (11377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135814.873021:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135814.873034:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135814.873040:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723283456:12345-0@lo:400: 00000100:00100000:2.0:1789135814.873192:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723283072:12345-0@lo:400: Request processed in 10527us (10745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135814.873229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789135814.875562:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135814.875684:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f22d00 x1876044723283712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135814.875722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723283712:0@lo:400: 00000100:00100000:2.0:1789135814.875877:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283840 00000100:00100000:2.0:1789135814.875910:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283840 00000100:00100000:2.0:1789135814.876012:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135814.876025:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723283840:12345-0@lo:13: 00002000:00000024:2.0:1789135814.876074:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135814.876169:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723283840:12345-0@lo:13: Request processed in 145us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135814.876176:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135814.877569:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723283456:12345-0@lo:400: Request processed in 4516us (14954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135814.877602:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789135814.877661:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135814.877668:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135814.877673:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135814.877757:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f23840 x1876044723283456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135814.877774:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723283456:0@lo:400: 00000100:00100000:1.0:1789135814.877790:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723283072:0@lo:400: 00000100:00100000:1.0:1789135814.877808:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723283584:0@lo:400: 00010000:00080000:0.0:1789135814.879839:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c39a580 x1876044723283840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135814.879870:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723283840:0@lo:13: 00000100:00100000:1.0:1789135815.372954:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135815.372997:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723283968:0@lo:13: 00000100:00100000:1.0:1789135815.374003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135815.374802:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723283968 00000100:00100000:2.0:1789135815.374825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723283968 00000100:00100000:2.0:1789135815.374915:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135815.374928:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723283968:12345-0@lo:13: 00002000:00000024:2.0:1789135815.374992:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135815.375087:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723283968:12345-0@lo:13: Request processed in 160us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135815.375096:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789135815.376697:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074302d00 x1876044723283968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135815.376759:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074302d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723283968:0@lo:13: 00010000:00010000:1.0:1789135815.518904:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135816.525079:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135816.559248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135816.559304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135816.559338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135816.559366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135816.559391:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998848 00000100:00100000:1.0:1789135816.559402:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998848 00000100:00100000:1.0:1789135816.559466:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998720 00000100:00100000:1.0:1789135816.559469:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998720 00000100:00100000:0.0:1789135816.559479:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:1.0:1789135816.559491:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789135816.559496:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044695998848:12345-192.168.204.41@tcp:400: 00000100:00100000:1.0:1789135816.559501:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789135816.559526:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998464 00000100:00100000:1.0:1789135816.559530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998464 00000100:00100000:1.0:1789135816.559561:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 132 00000100:00100000:1.0:1789135816.559570:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044695998464:12345-192.168.204.41@tcp:400: 00000100:00100000:0.0:1789135816.559577:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044695998848:12345-192.168.204.41@tcp:400: Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.559586:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:1.0:1789135816.559605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044695998464:12345-192.168.204.41@tcp:400: Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.559610:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:1.0:1789135816.559618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 132 00000100:00100000:0.0:1789135816.559623:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044695998720:12345-192.168.204.41@tcp:400: 00000100:00100000:0.0:1789135816.559654:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044695998720:12345-192.168.204.41@tcp:400: Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00080000:1.0:1789135816.559655:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135816.559662:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135816.559666:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789135816.563196:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998592 00000100:00100000:3.0:1789135816.563211:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998592 00000100:00100000:3.0:1789135816.563296:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:3.0:1789135816.563307:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044695998592:12345-192.168.204.41@tcp:400: 00000100:00100000:3.0:1789135816.563409:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044695998592:12345-192.168.204.41@tcp:400: Request processed in 103us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135816.563416:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00080000:1.0:1789135816.563486:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789135816.875083:0:8469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8ef8ed90 20000000:00000080:2.0:1789135816.875101:0:8469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba0739aa000 uarg=0000000000000000 20000000:01000000:2.0:1789135816.875140:0:8469:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789135816.875142:0:8469:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789135816.875145:0:8469:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789135816.875151:0:8469:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789135816.875156:0:8469:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789135816.875183:0:8469:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789135816.875186:0:8469:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789135816.875394:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789135816.875397:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135816.879052:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789135816.881370:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789135816.881460:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789135816.881537:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789135816.881562:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789135816.881565:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135816.884177:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789135816.885201:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789135816.885280:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789135816.885318:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789135816.885334:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789135816.885337:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135816.886420:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789135816.887151:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789135816.887211:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789135816.887239:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789135816.887259:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789135816.887262:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789135816.888390:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789135816.889232:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789135816.889304:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789135816.889342:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789135816.889364:0:8469:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789135816.889387:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889422:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889429:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889435:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889441:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889447:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889453:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889458:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889467:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889473:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889480:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889541:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.889563:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 9 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.889657:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284096:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135816.891531:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.891547:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.891562:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284224:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135816.891625:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.891633:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 18 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.891642:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284352:0@lo:104: 00000100:00100000:0.0:1789135816.891686:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135816.891833:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.891841:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.891871:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284480:0@lo:104: 00000100:00100000:0.0:1789135816.891900:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135816.894855:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.894871:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 18 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.894886:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284608:0@lo:104: 00010000:00010000:0.0:1789135816.894933:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.894941:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 18 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.894949:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284736:0@lo:104: 00010000:00010000:0.0:1789135816.894974:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.894981:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 18 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.894989:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284864:0@lo:104: 00010000:00010000:0.0:1789135816.895012:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.895019:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 18 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.895045:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284992:0@lo:104: 00010000:00010000:0.0:1789135816.895070:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.895078:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 18 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.895085:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723285120:0@lo:104: 00000100:00100000:0.0:1789135816.895103:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135816.899601:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789135816.899680:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135816.899761:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135816.899782:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135816.899795:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135816.899808:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135816.899822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284352 00000100:00100000:3.0:1789135816.899835:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284352 00000100:00100000:3.0:1789135816.899859:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284480 00000100:00100000:3.0:1789135816.899861:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284480 00000100:00100000:3.0:1789135816.899925:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284608 00000100:00100000:3.0:1789135816.899929:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284608 00000100:00100000:3.0:1789135816.899939:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284736 00000100:00100000:3.0:1789135816.899941:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284736 00000100:00100000:3.0:1789135816.899950:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284864 00000100:00100000:3.0:1789135816.899952:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284864 00000100:00100000:3.0:1789135816.899960:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723284992 00000100:00100000:3.0:1789135816.899963:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723284992 00000100:00100000:3.0:1789135816.899971:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285120 00000100:00100000:3.0:1789135816.899992:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285120 00000100:00100000:3.0:1789135816.900015:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135816.900032:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f472f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:8469:x1876044723284480:12345-0@lo:104: 00000100:00100000:2.0:1789135816.900059:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789135816.900085:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135816.900097:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:8469:x1876044723284608:12345-0@lo:104: 00010000:00010000:2.0:1789135816.900127:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135816.900204:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135816.900213:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f472f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+9:8469:x1876044723284480:12345-0@lo:104: Request processed in 188us (8310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135816.900221:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135816.900254:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135816.900263:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+8:8469:x1876044723284736:12345-0@lo:104: 00010000:00010000:2.0:1789135816.900269:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789135816.900276:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135816.900286:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+8:8469:x1876044723284608:12345-0@lo:104: Request processed in 203us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135816.900303:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789135816.900333:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789135816.900341:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:8469:x1876044723284736:12345-0@lo:104: Request processed in 79us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135816.900351:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135816.900363:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+7:8469:x1876044723284864:12345-0@lo:104: 00000100:00100000:3.0:1789135816.900367:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789135816.900383:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135816.900394:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135816.900407:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:8469:x1876044723284992:12345-0@lo:104: 00010000:00010000:3.0:1789135816.900417:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.900442:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789135816.900451:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:8469:x1876044723284864:12345-0@lo:104: Request processed in 90us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135816.900463:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789135816.900468:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789135816.900476:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+6:8469:x1876044723284992:12345-0@lo:104: Request processed in 73us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135816.900485:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135816.900566:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135816.900588:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:8469:x1876044723285120:12345-0@lo:104: 00010000:00010000:2.0:1789135816.900599:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.900641:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789135816.900645:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:8469:x1876044723285120:12345-0@lo:104: Request processed in 72us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135816.900670:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135816.902695:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1789135816.903402:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284096:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135816.903414:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284224:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135816.903426:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284480:0@lo:104: 00000100:00100000:0.0:1789135816.903435:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284608:0@lo:104: 00000100:00100000:0.0:1789135816.903443:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284736:0@lo:104: 00000100:00100000:0.0:1789135816.903452:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284864:0@lo:104: 00000100:00100000:0.0:1789135816.903460:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284992:0@lo:104: 00000100:00100000:0.0:1789135816.903468:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723285120:0@lo:104: 00010000:00010000:0.0:1789135816.904143:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789135816.904153:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904175:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904179:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904216:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904224:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904231:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904281:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904287:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904313:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904320:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031400/0x38eb79866bf95f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904336:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789135816.904339:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904344:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904347:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904354:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904360:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904370:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904384:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904389:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904402:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904409:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9400/0x38eb79866bf95f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904421:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789135816.904424:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904430:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9800 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904433:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904440:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904447:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904452:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904463:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904468:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904478:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904485:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf95f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904492:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789135816.904495:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904501:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9600 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904504:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904510:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904516:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904521:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904529:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904534:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904538:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904543:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9600/0x38eb79866bf95f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904551:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135816.904557:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904563:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cdc00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904566:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904572:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904578:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904583:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904591:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904596:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904599:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904605:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cdc00/0x38eb79866bf95eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ef2 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904613:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135816.904616:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904622:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cce00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135816.904625:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904639:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135816.904645:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135816.904650:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135816.904659:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904663:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135816.904667:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904672:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf95ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ec8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.904681:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135816.904682:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135816.904685:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135816.904728:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285376:0@lo:103: 00000100:00100000:0.0:1789135816.904913:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.904955:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285888:0@lo:103: 00000100:00100000:0.0:1789135816.904986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.905008:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135816.905013:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285504:0@lo:103: 00000100:00100000:0.0:1789135816.905029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.905054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285376 00000100:00100000:0.0:1789135816.905064:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285376 00010000:00010000:0.0:1789135816.905089:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 19 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.905111:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285888 00000100:00100000:0.0:1789135816.905113:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285888 00010000:00010000:0.0:1789135816.905121:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 20 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.905129:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285504 00000100:00100000:0.0:1789135816.905131:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285504 00010000:00010000:0.0:1789135816.905138:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 21 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.905149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135816.905156:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+21:3311:x1876044723285376:12345-0@lo:103: 00010000:00010000:0.0:1789135816.905180:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.905186:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 21 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905195:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 21 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905210:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030e00/0x38eb79866bf95f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95f31 expref: 21 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905223:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.905251:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+20:3311:x1876044723285376:12345-0@lo:103: Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.905258:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135816.905273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135816.905286:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723285888:12345-0@lo:103: 00010000:00010000:0.0:1789135816.905293:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.905297:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 19 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905305:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 19 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905314:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf95ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95ec1 expref: 19 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905322:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.905343:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3311:x1876044723285888:12345-0@lo:103: Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.905349:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135816.905361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135816.905367:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3311:x1876044723285504:12345-0@lo:103: 00010000:00010000:0.0:1789135816.905382:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.905387:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 17 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905394:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 17 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905404:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8200/0x38eb79866bf95f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95f23 expref: 17 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.905411:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.905430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3311:x1876044723285504:12345-0@lo:103: Request processed in 64us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.905444:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135816.905478:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285504:0@lo:103: 00000100:00100000:0.0:1789135816.905487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285376:0@lo:103: 00000100:00100000:0.0:1789135816.905493:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723285888:0@lo:103: 00000100:00100000:0.0:1789135816.907061:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285248:0@lo:103: 00000100:00100000:0.0:1789135816.907142:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.907201:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285760:0@lo:103: 00000100:00100000:0.0:1789135816.907220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.907237:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135816.907242:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285632:0@lo:103: 00000100:00100000:0.0:1789135816.907259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.907283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285248 00000100:00100000:0.0:1789135816.907290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285248 00010000:00010000:0.0:1789135816.907322:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 16 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.907342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285760 00000100:00100000:0.0:1789135816.907344:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285760 00010000:00010000:0.0:1789135816.907353:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 17 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.907364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723285632 00000100:00100000:0.0:1789135816.907366:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723285632 00010000:00010000:0.0:1789135816.907376:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 18 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.907388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135816.907408:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3314:x1876044723285248:12345-0@lo:103: 00010000:00010000:0.0:1789135816.907421:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.907426:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907436:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907452:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031a00/0x38eb79866bf95f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95f4d expref: 18 pid: 5842 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907466:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.907497:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3314:x1876044723285248:12345-0@lo:103: Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.907503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135816.907518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135816.907523:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3314:x1876044723285760:12345-0@lo:103: 00010000:00010000:0.0:1789135816.907530:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.907534:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 16 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907541:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 16 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907549:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031e00/0x38eb79866bf95ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95eeb expref: 16 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907556:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.907576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:3314:x1876044723285760:12345-0@lo:103: Request processed in 53us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.907591:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135816.907602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135816.907608:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3314:x1876044723285632:12345-0@lo:103: 00010000:00010000:0.0:1789135816.907615:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.907619:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 14 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907627:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 14 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907636:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf95f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95f15 expref: 14 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.907645:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.907666:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3314:x1876044723285632:12345-0@lo:103: Request processed in 58us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.907671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135816.907723:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285632:0@lo:103: 00000100:00100000:0.0:1789135816.907731:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285248:0@lo:103: 00000100:00100000:0.0:1789135816.907737:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723285760:0@lo:103: 00000100:00100000:3.0:1789135816.907998:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789135816.908113:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135816.908434:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:8469:x1876044723284352:12345-0@lo:104: 00010000:00010000:3.0:1789135816.908458:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135816.908582:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135816.908590:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:8469:x1876044723284352:12345-0@lo:104: Request processed in 578us (16904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.909111:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1876044723284352:0@lo:104: 00010000:00010000:0.0:1789135816.909195:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.911178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135816.911227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135816.911287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695998976 00000100:00100000:0.0:1789135816.911297:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695998976 00010000:00010000:0.0:1789135816.911347:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 10 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.911383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999104 00000100:00100000:0.0:1789135816.911388:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999104 00010000:00010000:0.0:1789135816.911401:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 11 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.911417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:0.0:1789135816.911427:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba049180450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:2363:x1876044695998976:12345-192.168.204.41@tcp:103: 00010000:00010000:0.0:1789135816.911444:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.911450:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 11 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.911464:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 11 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.911487:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cc000/0x38eb79866bf95f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe0f expref: 11 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.911508:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.911596:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba049180450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2363:x1876044695998976:12345-192.168.204.41@tcp:103: Request processed in 169us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.911604:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:0.0:1789135816.911677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:0.0:1789135816.911684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:2363:x1876044695999104:12345-192.168.204.41@tcp:103: 00010000:00010000:0.0:1789135816.911692:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.911738:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.912330:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.912347:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf95f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe08 expref: 9 pid: 5843 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.912361:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.912390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:2363:x1876044695999104:12345-192.168.204.41@tcp:103: Request processed in 707us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.912399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00010000:00010000:2.0:1789135816.913943:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135816.913961:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.913977:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:2.0:1789135816.913983:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.913994:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135816.914002:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135816.914009:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135816.914087:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.914095:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135816.914133:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.914140:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf95f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95f77 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.914159:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135816.914171:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135816.914173:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135816.914188:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135816.914230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723286016:0@lo:103: 00000100:00100000:2.0:1789135816.914312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135816.914470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286016 00000100:00100000:0.0:1789135816.914483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286016 00010000:00010000:0.0:1789135816.914545:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 13 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135816.914601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135816.914613:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:3311:x1876044723286016:12345-0@lo:103: 00010000:00010000:0.0:1789135816.914629:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135816.914636:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 13 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914649:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 13 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914670:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031000/0x38eb79866bf95f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95f70 expref: 13 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914694:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914763:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914790:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914802:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914810:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914817:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914823:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135816.914827:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.914835:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135816.915591:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789135816.917372:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135816.917402:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135816.917510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:3311:x1876044723286016:12345-0@lo:103: Request processed in 2897us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135816.917522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135816.917686:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723286016:0@lo:103: 00010000:00010000:2.0:1789135816.921661:0:8469:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.921687:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135816.921696:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030400/0x38eb79866bf95fcb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135817.553334:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789135818.317005:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135818.317013:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b9f45966800 from 39 10000000:01000000:2.0:1789135818.317018:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135818.317073:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.317085:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.317097:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135818.317121:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286144:0@lo:101: 00000100:00100000:2.0:1789135818.317201:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135818.317258:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06a907180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.317492:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286144 00000100:00100000:1.0:1789135818.317500:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286144 00000100:00100000:1.0:1789135818.317557:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789135818.317579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+12:5846:x1876044723286144:12345-0@lo:101: 00010000:00010000:1.0:1789135818.317596:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135818.317612:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8a00/0x38eb79866bf95fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95fd2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.317635:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8a00/0x38eb79866bf95fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95fd2 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.317646:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec8a00/0x38eb79866bf95fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95fd2 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.317656:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8a00, rc 0) 00000100:00100000:1.0:1789135818.317735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286144:12345-0@lo:101: Request processed in 170us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.317742:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789135818.318180:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286144:0@lo:101: 00010000:00010000:0.0:1789135818.318204:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.318213:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.318271:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286272:0@lo:501: 00000100:00100000:0.0:1789135818.318301:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.318335:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.318432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286272 00000100:00100000:1.0:1789135818.318437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286272 00000100:00100000:1.0:1789135818.318558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789135818.318577:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286272:12345-0@lo:501: 00000100:00100000:1.0:1789135818.318866:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286272:12345-0@lo:501: Request processed in 300us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.318874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789135818.318935:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286272:0@lo:501: 00000100:00100000:0.0:1789135818.318963:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286400:0@lo:503: 00000100:00100000:0.0:1789135818.318999:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.322536:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.322788:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286400 00000100:00100000:2.0:1789135818.322798:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286400 00000100:00100000:2.0:1789135818.322851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135818.322861:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286400:12345-0@lo:503: 00000100:00100000:2.0:1789135818.324227:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286400:12345-0@lo:503: Request processed in 1357us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.324260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789135818.324620:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286400:0@lo:503: 00000100:00100000:3.0:1789135818.325485:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8485:1876044723286528:0@lo:502: 00000100:00100000:3.0:1789135818.325559:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.325600:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.325732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286528 00000100:00100000:1.0:1789135818.325739:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286528 00000100:00100000:1.0:1789135818.325786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789135818.325796:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:8485:x1876044723286528:12345-0@lo:502: 00000100:00100000:1.0:1789135818.326378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:8485:x1876044723286528:12345-0@lo:502: Request processed in 582us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.326387:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789135818.326466:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8485:1876044723286528:0@lo:502: 00000100:00100000:3.0:1789135818.326516:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8485:1876044723286656:0@lo:502: 00000100:00100000:3.0:1789135818.326557:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.326593:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.326642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286656 00000100:00100000:2.0:1789135818.326647:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286656 00000100:00100000:2.0:1789135818.326694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789135818.326734:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:8485:x1876044723286656:12345-0@lo:502: 00000100:00100000:2.0:1789135818.326896:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:8485:x1876044723286656:12345-0@lo:502: Request processed in 194us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.326903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135818.327304:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8485:1876044723286656:0@lo:502: 00000040:00080000:3.0:1789135818.327326:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789135818.327595:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789135818.327614:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135818.327624:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.327635:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135818.327645:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789135818.327648:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789135818.327651:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789135818.327827:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.327850:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.327860:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.327924:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286784:0@lo:101: 00000100:00100000:0.0:1789135818.327965:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.328216:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.328603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286784 00000100:00100000:1.0:1789135818.328609:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286784 00000100:00100000:1.0:1789135818.328821:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135818.328830:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+13:5846:x1876044723286784:12345-0@lo:101: 00010000:00010000:1.0:1789135818.328842:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135818.328858:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9c00/0x38eb79866bf95fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95fe0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.328893:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9c00/0x38eb79866bf95fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95fe0 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.328903:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9c00/0x38eb79866bf95fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95fe0 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.328913:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9c00, rc 0) 00000100:00100000:1.0:1789135818.328993:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723286784:12345-0@lo:101: Request processed in 163us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.329000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789135818.329088:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286784:0@lo:101: 00010000:00010000:0.0:1789135818.329103:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.329111:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.329180:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286912:0@lo:501: 00000100:00100000:0.0:1789135818.329211:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.329606:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.329815:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723286912 00000100:00100000:2.0:1789135818.329821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723286912 00000100:00100000:2.0:1789135818.329861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789135818.329877:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723286912:12345-0@lo:501: 00000100:00100000:2.0:1789135818.330193:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723286912:12345-0@lo:501: Request processed in 323us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.330200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789135818.331448:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723286912:0@lo:501: 00000100:00100000:0.0:1789135818.332049:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287040:0@lo:503: 00000100:00100000:0.0:1789135818.332284:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.332330:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.332383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287040 00000100:00100000:2.0:1789135818.332390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287040 00000100:00100000:2.0:1789135818.332431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789135818.332440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723287040:12345-0@lo:503: 00000100:00100000:2.0:1789135818.336607:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723287040:12345-0@lo:503: Request processed in 4158us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.336622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789135818.343082:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287040:0@lo:503: 00000100:00100000:2.0:1789135818.346959:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8486:1876044723287168:0@lo:502: 00000100:00100000:2.0:1789135818.347077:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135818.347122:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135818.347561:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287168 00000100:00100000:3.0:1789135818.347578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287168 00000100:00100000:3.0:1789135818.347631:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789135818.347639:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8486:x1876044723287168:12345-0@lo:502: 00000100:00100000:3.0:1789135818.347911:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8486:x1876044723287168:12345-0@lo:502: Request processed in 271us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135818.347925:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789135818.348384:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8486:1876044723287168:0@lo:502: 00000020:01000000:2.0:1789135818.348423:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135818.348433:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135818.348435:0:8486:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789135818.348441:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789135818.348553:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8486:1876044723287296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135818.348594:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135818.348631:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.348802:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287296 00000100:00100000:0.0:1789135818.348814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287296 00000100:00100000:0.0:1789135818.348891:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789135818.348900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8486:x1876044723287296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135818.349082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:8486:x1876044723287296:12345-0@lo:502:llog_process_th.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.349089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789135818.349411:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8486:1876044723287296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135818.349434:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135818.349441:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135818.349443:0:8486:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789135818.349446:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789135818.350286:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789135818.350308:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789135818.350318:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.350331:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135818.350341:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789135818.350343:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba0504e6000 from 39 10000000:01000000:0.0:1789135818.350346:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135818.350376:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.350384:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.350394:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.350415:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.350867:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.351004:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135818.351047:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287424 00000100:00100000:3.0:1789135818.351054:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287424 00000100:00100000:3.0:1789135818.351287:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789135818.351297:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:5846:x1876044723287424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135818.351310:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135818.351337:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5400/0x38eb79866bf95ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95fee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.351365:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5400/0x38eb79866bf95ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95fee expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.351376:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5400/0x38eb79866bf95ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95fee expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.351386:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5400, rc 0) 00000100:00100000:3.0:1789135818.351596:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723287424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 300us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135818.351603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135818.352318:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135818.352342:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.352353:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135818.352438:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.353348:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.353393:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.353497:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287552 00000100:00100000:0.0:1789135818.353518:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287552 00000100:00100000:0.0:1789135818.353578:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789135818.353589:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723287552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.354322:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723287552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 733us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.354332:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789135818.356257:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.356324:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.356401:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.356437:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.356954:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287680 00000100:00100000:0.0:1789135818.356961:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287680 00000100:00100000:0.0:1789135818.357014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789135818.357024:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723287680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.358015:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723287680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 988us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.358024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135818.359002:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723287680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135818.360004:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8487:1876044723287808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.360446:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.360565:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.360621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287808 00000100:00100000:1.0:1789135818.360628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287808 00000100:00100000:1.0:1789135818.360813:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789135818.360823:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8487:x1876044723287808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.361427:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8487:x1876044723287808:12345-0@lo:502:llog_process_th.0 Request processed in 603us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.361448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789135818.367251:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8487:1876044723287808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.367951:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8487:1876044723287936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.368034:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.368095:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.370276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723287936 00000100:00100000:1.0:1789135818.370290:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723287936 00000100:00100000:1.0:1789135818.370370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789135818.370381:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8487:x1876044723287936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.370844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:8487:x1876044723287936:12345-0@lo:502:llog_process_th.0 Request processed in 465us (2809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.370853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789135818.371647:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8487:1876044723287936:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789135818.371735:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789135818.372006:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789135818.372027:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135818.372038:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.372050:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135818.372228:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789135818.372232:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789135818.372236:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135818.372274:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.372285:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.372294:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135818.372318:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.372452:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.372929:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.379028:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288064 00000100:00100000:0.0:1789135818.379043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288064 00000100:00100000:1.0:1789135818.379277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789135818.379288:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:5846:x1876044723288064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135818.379304:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135818.379323:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf96003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf95ffc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.379607:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf96003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf95ffc expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.379620:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf96003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95ffc expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.379630:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9e00, rc 0) 00000100:00100000:1.0:1789135818.379950:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 663us (7496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.379959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135818.380103:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135818.380125:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.380218:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135818.380292:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135818.380530:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135818.380559:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.381116:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288192 00000100:00100000:0.0:1789135818.381122:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288192 00000100:00100000:0.0:1789135818.381289:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789135818.381299:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.381641:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.381650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135818.381763:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135818.381810:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135818.381854:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.388064:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288320 00000100:00100000:0.0:1789135818.388079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288320 00000100:00100000:1.0:1789135818.389484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789135818.389988:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.390287:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 789us (8430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.390298:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789135818.390414:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.390508:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.391468:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8488:1876044723288448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.392102:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.392196:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.392292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288448 00000100:00100000:0.0:1789135818.392301:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288448 00000100:00100000:0.0:1789135818.392628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789135818.392648:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8488:x1876044723288448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135818.392888:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8488:x1876044723288448:12345-0@lo:502:llog_process_th.0 Request processed in 251us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.392895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135818.396316:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8488:1876044723288448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135818.396389:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135818.396399:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135818.396402:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789135818.396407:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789135818.397654:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8488:1876044723288576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135818.397771:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135818.397810:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135818.397853:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288576 00000100:00100000:0.0:1789135818.397866:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288576 00000100:00100000:0.0:1789135818.397934:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789135818.397956:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8488:x1876044723288576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135818.398861:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:8488:x1876044723288576:12345-0@lo:502:llog_process_th.0 Request processed in 915us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.398872:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135818.398991:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8488:1876044723288576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135818.400226:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135818.400242:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135818.400245:0:8488:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789135818.400266:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789135818.400561:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789135818.400579:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789135818.400587:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.400595:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135818.400604:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789135818.400606:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba04857c800 from 39 10000000:01000000:0.0:1789135818.400609:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135818.400637:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.400650:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.400658:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.400675:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.401065:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.401101:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135818.401346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288704 00000100:00100000:3.0:1789135818.401353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288704 00000100:00100000:3.0:1789135818.401530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789135818.401541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723288704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135818.401556:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135818.401571:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf96011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9600a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.401600:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf96011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9600a expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.401613:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf96011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9600a expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135818.401624:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5000, rc 0) 00000100:00100000:3.0:1789135818.401748:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723288704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135818.401756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789135818.401828:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135818.401843:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.401853:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.401911:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.402010:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.402041:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.404452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288832 00000100:00100000:1.0:1789135818.404466:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288832 00000100:00100000:1.0:1789135818.404533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789135818.404543:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723288832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.404932:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723288832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.404940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789135818.408740:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.408807:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.408917:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.408971:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.409358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723288960 00000100:00100000:2.0:1789135818.409366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723288960 00000100:00100000:2.0:1789135818.409431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135818.409441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723288960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135818.409664:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723288960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.409672:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789135818.410754:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723288960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135818.411578:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8489:1876044723289088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.411676:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.411745:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.413634:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289088 00000100:00100000:2.0:1789135818.413650:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289088 00000100:00100000:2.0:1789135818.413768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789135818.413779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8489:x1876044723289088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135818.414371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8489:x1876044723289088:12345-0@lo:502:llog_process_th.0 Request processed in 592us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.414380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135818.414876:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1ba940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8489:1876044723289088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.414953:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8489:1876044723289216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.415164:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.415222:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.415355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289216 00000100:00100000:2.0:1789135818.415361:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289216 00000100:00100000:2.0:1789135818.415410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789135818.415592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8489:x1876044723289216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135818.416030:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8489:x1876044723289216:12345-0@lo:502:llog_process_th.0 Request processed in 442us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.416039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789135818.416241:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8489:1876044723289216:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789135818.416279:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789135818.416511:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789135818.416547:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135818.416559:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.416570:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135818.416581:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789135818.416584:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789135818.416588:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135818.416626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.416634:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.416643:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.416663:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.416726:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.416768:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.416974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289344 00000100:00100000:2.0:1789135818.416980:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289344 00000100:00100000:2.0:1789135818.417026:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135818.417035:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723289344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135818.417046:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135818.417069:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf9601f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96018 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.417090:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf9601f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96018 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.417100:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf9601f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96018 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.417109:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e600, rc 0) 00000100:00100000:2.0:1789135818.417263:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.417270:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789135818.418652:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135818.418680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.418693:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135818.418788:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.418870:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.418907:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.419041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289472 00000100:00100000:2.0:1789135818.419047:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289472 00000100:00100000:2.0:1789135818.419107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789135818.419117:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135818.419443:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135818.419460:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135818.419666:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.419755:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135818.419799:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.419821:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135818.420617:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289600 00000100:00100000:2.0:1789135818.420626:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289600 00000100:00100000:2.0:1789135818.420689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789135818.421159:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135818.421492:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 792us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135818.421500:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789135818.421679:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135818.425282:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8490:1876044723289728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.425396:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.425444:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.425497:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289728 00000100:00100000:1.0:1789135818.425505:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289728 00000100:00100000:1.0:1789135818.425554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789135818.425563:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8490:x1876044723289728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.425858:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8490:x1876044723289728:12345-0@lo:502:llog_process_th.0 Request processed in 295us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.425867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789135818.426216:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8490:1876044723289728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135818.426247:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135818.426258:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135818.426260:0:8490:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789135818.426268:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789135818.426296:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8490:1876044723289856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135818.426343:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135818.426374:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.426724:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289856 00000100:00100000:1.0:1789135818.426731:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289856 00000100:00100000:1.0:1789135818.426771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789135818.426779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8490:x1876044723289856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135818.427106:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8490:x1876044723289856:12345-0@lo:502:llog_process_th.0 Request processed in 326us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135818.427119:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789135818.427592:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8490:1876044723289856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135818.427619:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135818.427625:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135818.427627:0:8490:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789135818.427631:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789135818.429980:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789135818.430229:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789135818.430243:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.430257:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135818.430268:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789135818.430271:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ba0592cced8 from 1 10000000:01000000:1.0:1789135818.430274:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789135818.430323:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.430332:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.430343:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135818.430371:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.437383:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135818.437483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723289984 00000100:00100000:0.0:1789135818.437493:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723289984 00000100:00100000:0.0:1789135818.437573:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789135818.437586:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723289984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135818.437608:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135818.437631:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040031400/0x38eb79866bf9602d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96026 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.437668:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031400/0x38eb79866bf9602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96026 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.437679:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040031400/0x38eb79866bf9602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96026 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135818.437689:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031400, rc 0) 00000100:00100000:0.0:1789135818.445831:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723289984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8232us (8444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135818.445847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789135818.445866:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135818.445897:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723289984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135818.445923:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.445957:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135818.446408:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723290112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135818.446531:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135818.446560:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135818.446744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290112 00000100:00100000:3.0:1789135818.446752:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290112 00000100:00100000:3.0:1789135818.446795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135818.446810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723290112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135818.447047:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723290112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135818.447055:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789135818.449407:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723290112:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789135818.449472:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789135818.449484:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135818.449497:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135818.572892:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135819.598916:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135819.983951:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723290368:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984031:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984094:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723290880:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984166:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789135819.984172:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723290240:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984220:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723290752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984265:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723290624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984291:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984308:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135819.984313:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723290496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.984360:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290880 00000100:00100000:0.0:1789135819.984367:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290880 00000100:00100000:0.0:1789135819.984416:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290624 00000100:00100000:0.0:1789135819.984419:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290624 00000100:00100000:0.0:1789135819.984438:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135819.984447:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723290880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984500:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723290880:12345-0@lo:400:kworker.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135819.984507:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135819.984542:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135819.984549:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074152d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984582:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074152d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723290624:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135819.984589:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789135819.984622:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76d00 x1876044723290880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135819.984635:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723290880:0@lo:400:kworker.0 00010000:00080000:0.0:1789135819.984665:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f77840 x1876044723290624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135819.984676:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723290624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984691:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290240 00000100:00100000:0.0:1789135819.984695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290240 00000100:00100000:0.0:1789135819.984748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789135819.984755:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.984787:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723290240:12345-0@lo:400:kworker.0 Request processed in 32us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135819.984794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789135819.984825:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723290240:0@lo:400:kworker.0 00000100:00100000:1.0:1789135819.984966:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290368 00000100:00100000:1.0:1789135819.984969:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290368 00000100:00100000:1.0:1789135819.984994:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290752 00000100:00100000:1.0:1789135819.984997:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290752 00000100:00100000:1.0:1789135819.985010:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723290496 00000100:00100000:1.0:1789135819.985012:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723290496 00000100:00100000:1.0:1789135819.985026:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135819.985032:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723290368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135819.985070:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723290368:12345-0@lo:400:kworker.0 Request processed in 37us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135819.985076:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135819.985089:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135819.985095:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723290752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135819.985148:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723290752:12345-0@lo:400:kworker.0 Request processed in 53us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135819.985154:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135819.985166:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135819.985171:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074152580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723290496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135819.985195:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074152580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723290496:12345-0@lo:400:kworker.0 Request processed in 24us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135819.985201:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789135819.985224:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135819.985229:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135819.985232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135819.986177:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723291008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135819.986256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.987779:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723290496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.987833:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723290752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.987848:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723290368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135819.987952:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291008 00000100:00100000:3.0:1789135819.987960:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291008 00000100:00100000:3.0:1789135819.988023:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135819.988034:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723291008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135819.988072:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135819.988165:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723291008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135819.988173:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789135819.988251:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76580 x1876044723291008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135819.988271:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723291008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135820.493060:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135820.493085:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723291136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135820.493169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135820.493331:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291136 00000100:00100000:3.0:1789135820.493355:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291136 00000100:00100000:3.0:1789135820.493422:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135820.493434:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723291136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135820.493479:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135820.493552:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723291136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135820.493560:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789135820.493664:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f75a40 x1876044723291136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135820.493688:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723291136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135820.620868:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135821.166933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135821.167031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999232 00000100:00100000:3.0:1789135821.167042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999232 00000100:00100000:3.0:1789135821.167115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:3.0:1789135821.167125:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:5611:x1876044695999232:12345-192.168.204.41@tcp:101: 00010000:00010000:3.0:1789135821.167144:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135821.167162:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4800/0x38eb79866bf96034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe71 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135821.167190:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4800/0x38eb79866bf96034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe71 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135821.167201:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4800/0x38eb79866bf96034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe71 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135821.167210:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4800, rc 0) 00000100:00100000:3.0:1789135821.167261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999232:12345-192.168.204.41@tcp:101: Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135821.167268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:0.0:1789135821.169950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135821.170384:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999360 00000100:00100000:3.0:1789135821.170398:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999360 00000100:00100000:3.0:1789135821.170482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 167 00000100:00100000:3.0:1789135821.170495:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999360:12345-192.168.204.41@tcp:501: 00000100:00100000:2.0:1789135821.172239:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999360:12345-192.168.204.41@tcp:501: Request processed in 1732us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135821.172256:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 167 00000100:00100000:1.0:1789135821.177573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135821.177680:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999488 00000100:00100000:0.0:1789135821.177696:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999488 00000100:00100000:0.0:1789135821.177830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 168 00000100:00100000:0.0:1789135821.177842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999488:12345-192.168.204.41@tcp:503: 00000100:00100000:0.0:1789135821.178213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999488:12345-192.168.204.41@tcp:503: Request processed in 372us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135821.178225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 168 00000100:00100000:1.0:1789135821.191427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135821.191557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999616 00000100:00100000:2.0:1789135821.191571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999616 00000100:00100000:2.0:1789135821.191664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 169 00000100:00100000:2.0:1789135821.191676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:6095:x1876044695999616:12345-192.168.204.41@tcp:502: 00000100:00100000:2.0:1789135821.192954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:6095:x1876044695999616:12345-192.168.204.41@tcp:502: Request processed in 1271us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135821.192978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 169 00000100:00100000:1.0:1789135821.197302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135821.197516:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999744 00000100:00100000:3.0:1789135821.197530:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999744 00000100:00100000:3.0:1789135821.197613:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 170 00000100:00100000:3.0:1789135821.197627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:6095:x1876044695999744:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135821.198054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:6095:x1876044695999744:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 428us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135821.198064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 170 00000100:00100000:1.0:1789135821.210295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135821.211596:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044695999872 00000100:00100000:2.0:1789135821.211613:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044695999872 00000100:00100000:2.0:1789135821.211776:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:2.0:1789135821.211853:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044695999872:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135821.211884:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135821.211916:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9603b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe78 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135821.211965:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9603b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe78 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135821.211981:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9603b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe78 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135821.211994:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f200, rc 0) 00000100:00100000:2.0:1789135821.212113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044695999872:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 325us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135821.212456:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:1.0:1789135821.215298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135821.215415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000000 00000100:00100000:0.0:1789135821.215426:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000000 00000100:00100000:0.0:1789135821.215504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 172 00000100:00100000:0.0:1789135821.215516:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000000:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135821.216197:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000000:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 678us (908us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135821.216209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 172 00010000:00010000:3.0:1789135821.647103:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135821.679361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135821.679451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135821.679489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135821.679543:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000128 00000100:00100000:3.0:1789135821.679553:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000128 00000100:00100000:3.0:1789135821.679625:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:3.0:1789135821.679636:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696000128:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135821.679764:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696000128:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135821.679772:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00080000:3.0:1789135821.679798:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135821.681369:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000256 00000100:00100000:0.0:1789135821.681383:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000256 00000100:00100000:2.0:1789135821.681490:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000384 00000100:00080000:1.0:1789135821.681559:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135821.681593:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:1.0:1789135821.681607:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696000256:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135821.681689:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696000256:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 87us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135821.681733:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:2.0:1789135821.682618:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000384 00000100:00100000:2.0:1789135821.682737:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:2.0:1789135821.682749:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696000384:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135821.682839:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696000384:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 92us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135821.682857:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00080000:1.0:1789135821.683934:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1789135822.405424:0:8530:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3303ffe0 20000000:00000080:2.0:1789135822.405448:0:8530:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b9f462eac00 uarg=0000000000000000 20000000:01000000:2.0:1789135822.405489:0:8530:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789135822.405496:0:8530:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789135822.405501:0:8530:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789135822.414886:0:8531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789135822.421290:0:8530:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789135822.431088:0:8530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789135822.431577:0:8530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789135822.431659:0:8530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789135822.431683:0:8530:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135822.431737:0:8530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431760:0:8530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431768:0:8530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431791:0:8530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf95edd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431804:0:8530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431813:0:8530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431868:0:8530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.431888:0:8530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 9 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135822.431909:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291264:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135822.432100:0:8530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.432109:0:8530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 18 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135822.432119:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291392:0@lo:104: 00000100:00100000:0.0:1789135822.432186:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135822.432232:0:8530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.432241:0:8530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 18 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135822.432261:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291520:0@lo:104: 00000100:00100000:0.0:1789135822.432286:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135822.432544:0:8530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.432554:0:8530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 18 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135822.432621:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291648:0@lo:104: 00000100:00100000:0.0:1789135822.432645:0:8530:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042f28c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135822.433461:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789135822.433493:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135822.433529:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291392 00000100:00100000:0.0:1789135822.433537:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291392 00000100:00100000:0.0:1789135822.433616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291520 00000100:00100000:0.0:1789135822.433619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291520 00000100:00100000:0.0:1789135822.433630:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291648 00000100:00100000:0.0:1789135822.433632:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291648 00000100:00100000:0.0:1789135822.433647:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135822.433658:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:8530:x1876044723291392:12345-0@lo:104: 00010000:00010000:0.0:1789135822.433685:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.433781:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135822.433786:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:8530:x1876044723291392:12345-0@lo:104: Request processed in 131us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135822.433793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135822.433812:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135822.433834:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f47301050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:8530:x1876044723291520:12345-0@lo:104: 00010000:00010000:0.0:1789135822.433842:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.433876:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789135822.433881:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f47301050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:8530:x1876044723291520:12345-0@lo:104: Request processed in 49us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135822.433886:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135822.433928:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135822.433935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:8530:x1876044723291648:12345-0@lo:104: 00010000:00010000:0.0:1789135822.433942:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.433968:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789135822.433973:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:8530:x1876044723291648:12345-0@lo:104: Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135822.433979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135822.434241:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291392:0@lo:104: 00000100:00100000:0.0:1789135822.434254:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291520:0@lo:104: 00000100:00100000:0.0:1789135822.434261:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291648:0@lo:104: 00010000:00010000:3.0:1789135822.434457:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789135822.434469:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.434477:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135822.434482:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.434492:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135822.434513:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135822.434520:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789135822.434857:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8530:1876044723291264:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135822.434886:0:8530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435122:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435129:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135822.435235:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435243:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030800/0x38eb79866bf95edd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95ee4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435257:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135822.435260:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435266:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cc600 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135822.435269:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435276:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135822.435283:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135822.435289:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789135822.435309:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789135822.435315:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435321:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789135822.435324:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723291776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135822.435327:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435332:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc600/0x38eb79866bf95e12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95e19 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435341:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135822.435344:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435349:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135822.435352:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435359:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135822.435365:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.435368:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789135822.435370:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135822.435381:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.435386:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135822.435401:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.435404:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723291904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135822.435418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031c00/0x38eb79866bf95db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf95db7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.435423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135822.435434:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135822.435436:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135822.435437:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135822.435444:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135822.435452:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723292032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135822.435452:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291776 00000100:00100000:1.0:1789135822.435457:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291776 00000100:00100000:3.0:1789135822.435477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135822.435480:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 19 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.435502:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723291904 00000100:00100000:1.0:1789135822.435505:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723291904 00010000:00010000:3.0:1789135822.435514:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135822.435515:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 20 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.435525:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292032 00000100:00100000:1.0:1789135822.435527:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292032 00000100:00100000:3.0:1789135822.435530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789135822.435536:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 21 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135822.435539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+21:3314:x1876044723291776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135822.435547:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135822.435552:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+21:3314:x1876044723291904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135822.435563:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135822.435568:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 21 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435578:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 21 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435605:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf95e19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95e12 expref: 21 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435618:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135822.435650:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+20:3314:x1876044723291904:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135822.435668:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135822.435685:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135822.435692:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723292032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135822.435732:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135822.435737:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 19 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435745:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 19 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435754:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf95db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95db0 expref: 19 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.435762:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135822.435788:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3312:x1876044723292032:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135822.435794:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135822.435981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723292032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135822.436004:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723291904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135822.436114:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135822.436121:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 17 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.436129:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 17 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.436140:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cd800/0x38eb79866bf95ee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf95edd expref: 17 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135822.436422:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135822.436465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3314:x1876044723291776:12345-0@lo:103:ldlm_bl.0 Request processed in 927us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135822.436472:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135822.436763:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723291776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135822.436795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135822.437121:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000512 00000100:00100000:1.0:1789135822.437126:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000512 00010000:00010000:1.0:1789135822.437154:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135822.437185:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:1.0:1789135822.437193:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2363:x1876044696000512:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135822.437202:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135822.437207:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437218:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437231:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cc800/0x38eb79866bf95fa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe40 expref: 10 pid: 5844 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437243:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437252:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437267:0:6713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437275:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437282:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437296:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437302:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135822.437307:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437314:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437336:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135822.437348:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135822.437400:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:2363:x1876044696000512:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 208us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135822.437408:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00010000:00010000:0.0:1789135822.437828:0:8530:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.437851:0:8530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.437858:0:8530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030600/0x38eb79866bf96042 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135822.672570:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135822.871046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135822.871183:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000640 00000100:00100000:2.0:1789135822.871194:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000640 00000100:00100000:2.0:1789135822.871259:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 173 00000100:00100000:2.0:1789135822.871269:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:5611:x1876044696000640:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135822.871289:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135822.871309:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe7f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135822.871338:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135822.871350:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135822.871360:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0ee00, rc 0) 00000100:00100000:2.0:1789135822.871418:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000640:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 151us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135822.871425:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 173 00000100:00100000:2.0:1789135822.884147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135822.884301:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000768 00000100:00100000:3.0:1789135822.884312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000768 00000100:00100000:3.0:1789135822.884372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 174 00000100:00100000:3.0:1789135822.884382:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000768:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135822.884686:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000768:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 304us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135822.884694:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 174 00000100:00100000:3.0:1789135822.893433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135822.893526:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696000896 00000100:00100000:1.0:1789135822.893537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696000896 00000100:00100000:1.0:1789135822.893600:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:1.0:1789135822.893611:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000896:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135822.893870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:5611:x1876044696000896:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 260us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135822.893878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:1.0:1789135822.900819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135822.901064:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001024 00000100:00100000:2.0:1789135822.901089:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001024 00000100:00100000:2.0:1789135822.901172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00100000:2.0:1789135822.901187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:6152:x1876044696001024:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135822.901545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:6152:x1876044696001024:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 360us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135822.901558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00100000:2.0:1789135822.913440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135822.918508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001152 00000100:00100000:3.0:1789135822.918525:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001152 00000100:00100000:3.0:1789135822.918612:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 177 00000100:00100000:3.0:1789135822.918623:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:6152:x1876044696001152:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135822.919010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:6152:x1876044696001152:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 387us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135822.919019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 177 00010000:00010000:3.0:1789135823.694042:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135823.820786:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135823.820799:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b9f45966800 from 4 10000000:01000000:1.0:1789135823.820806:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135823.820902:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.820919:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.820934:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135823.820974:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.821104:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.821186:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135823.821487:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292160 00000100:00100000:0.0:1789135823.821505:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292160 00000100:00100000:0.0:1789135823.821565:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789135823.821576:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723292160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135823.821599:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135823.821624:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96050 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.821656:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96050 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.821668:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96050 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.821678:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135823.821964:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 389us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135823.821973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789135823.822020:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135823.822055:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.822067:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135823.822163:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.822216:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.822268:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135823.822313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292288 00000100:00100000:1.0:1789135823.822320:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292288 00000100:00100000:1.0:1789135823.822374:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789135823.822384:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.822829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 445us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135823.822850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789135823.823652:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135823.823763:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135823.823836:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135823.824023:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.824098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292416 00000100:00100000:3.0:1789135823.824105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292416 00000100:00100000:3.0:1789135823.824153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789135823.824164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.824987:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 818us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.824998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789135823.825158:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135823.828319:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8580:1876044723292544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135823.828440:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135823.828495:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.828522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292544 00000100:00100000:3.0:1789135823.828536:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292544 00000100:00100000:3.0:1789135823.828604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789135823.828638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8580:x1876044723292544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135823.831563:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8580:x1876044723292544:12345-0@lo:502:llog_process_th.0 Request processed in 2911us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.831582:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789135823.833403:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8580:1876044723292544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135823.833466:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135823.833483:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135823.833486:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135823.833496:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b9f45966800 00000020:00000080:2.0:1789135823.833499:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135823.833666:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8580:1876044723292672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135823.833819:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135823.833881:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.835017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292672 00000100:00100000:3.0:1789135823.835043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292672 00000100:00100000:3.0:1789135823.835119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789135823.835132:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8580:x1876044723292672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135823.835486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:8580:x1876044723292672:12345-0@lo:502:llog_process_th.0 Request processed in 356us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.835496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789135823.835992:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8580:1876044723292672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135823.836060:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135823.836072:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135823.836075:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135823.836082:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789135823.838474:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789135823.838525:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135823.838541:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.838558:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135823.838572:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135823.838575:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba0504e6000 from 4 10000000:01000000:3.0:1789135823.838579:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135823.838642:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.838652:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.838666:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135823.838737:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.838831:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135823.838884:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.838919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292800 00000100:00100000:3.0:1789135823.838928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292800 00000100:00100000:3.0:1789135823.841455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789135823.841476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723292800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135823.841502:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135823.841527:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9605e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.841567:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9605e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.841583:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9605e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.841596:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135823.841742:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723292800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.843957:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789135823.844115:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135823.844157:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.844174:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135823.844319:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.844396:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135823.844465:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.844994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723292928 00000100:00100000:3.0:1789135823.845003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723292928 00000100:00100000:3.0:1789135823.845082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789135823.845096:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723292928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.845822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723292928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 724us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.845834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789135823.845895:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723292928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.847564:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.847676:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135823.847769:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.847806:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293056 00000100:00100000:3.0:1789135823.847814:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293056 00000100:00100000:3.0:1789135823.849822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789135823.849837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723293056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.851417:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135823.851964:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723293056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1463us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.851982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789135823.853771:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8582:1876044723293184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135823.853887:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135823.853963:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135823.854583:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293184 00000100:00100000:1.0:1789135823.854602:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293184 00000100:00100000:1.0:1789135823.854691:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789135823.854744:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8582:x1876044723293184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135823.855131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8582:x1876044723293184:12345-0@lo:502:llog_process_th.0 Request processed in 430us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135823.855142:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789135823.855369:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8582:1876044723293184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135823.855418:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135823.855816:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135823.855820:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135823.855831:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba0504e6000 00000020:00000080:2.0:1789135823.855834:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135823.855987:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8582:1876044723293312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135823.856098:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135823.856157:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135823.856507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293312 00000100:00100000:3.0:1789135823.856517:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293312 00000100:00100000:3.0:1789135823.856576:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789135823.856590:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8582:x1876044723293312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135823.857274:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:8582:x1876044723293312:12345-0@lo:502:llog_process_th.0 Request processed in 684us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135823.857286:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789135823.862086:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f203c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8582:1876044723293312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135823.862383:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135823.862396:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135823.862399:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135823.862406:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789135823.862836:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789135823.862872:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135823.862885:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.863861:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135823.863877:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135823.863881:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 4 10000000:01000000:1.0:1789135823.863885:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135823.864025:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.864046:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.864061:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135823.864122:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.864226:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.864290:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135823.864960:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293440 00000100:00100000:0.0:1789135823.864969:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293440 00000100:00100000:0.0:1789135823.865043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789135823.865054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723293440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135823.865080:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135823.865097:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9606c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.865125:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9606c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.865136:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9606c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.865145:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030400, rc 0) 00000100:00100000:0.0:1789135823.865217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723293440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135823.865226:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789135823.866858:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135823.867390:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.867406:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135823.868071:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.868142:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.868186:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135823.868264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293568 00000100:00100000:0.0:1789135823.868274:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293568 00000100:00100000:0.0:1789135823.868334:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789135823.868347:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723293568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135823.870303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723293568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1949us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135823.870318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789135823.873356:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.873439:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.873612:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.873661:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135823.873688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293696 00000100:00100000:1.0:1789135823.873694:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293696 00000100:00100000:1.0:1789135823.873755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789135823.873763:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723293696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.873995:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723293696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135823.874004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789135823.874077:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723293696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135823.874293:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8585:1876044723293824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135823.874331:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.874356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293824 00000100:00100000:1.0:1789135823.874361:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293824 00000100:00100000:1.0:1789135823.874385:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789135823.874393:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:8585:x1876044723293824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135823.874569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:8585:x1876044723293824:12345-0@lo:502:llog_process_th.0 Request processed in 175us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135823.874576:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789135823.874628:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135823.874642:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8585:1876044723293824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135823.874664:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135823.874674:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135823.874676:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789135823.874683:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba04857c800 00000020:00000080:1.0:1789135823.874686:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135823.874778:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8585:1876044723293952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135823.874819:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.874839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723293952 00000100:00100000:1.0:1789135823.874843:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723293952 00000100:00100000:1.0:1789135823.874868:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789135823.874880:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:8585:x1876044723293952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135823.875005:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:8585:x1876044723293952:12345-0@lo:502:llog_process_th.0 Request processed in 131us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135823.875012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789135823.875065:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0739e9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135823.875080:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:8585:1876044723293952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135823.875099:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135823.875103:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135823.875105:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789135823.875109:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789135823.875168:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789135823.875188:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135823.875198:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.875208:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135824.717277:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135825.100917:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135825.100942:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723294336:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.101093:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723294208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135825.101143:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294336 00000100:00100000:0.0:1789135825.101152:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294336 00000100:00100000:1.0:1789135825.101170:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723294848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135825.101205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789135825.101218:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723294336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101220:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135825.101229:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723294720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.101281:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294208 00000100:00100000:1.0:1789135825.101285:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294208 00000100:00100000:0.0:1789135825.101296:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723294336:12345-0@lo:400:kworker.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135825.101305:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135825.101320:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789135825.101324:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294720 00000100:00100000:0.0:1789135825.101329:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294720 00000100:00100000:1.0:1789135825.101330:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723294208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.101365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723294208:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.101372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789135825.101399:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294848 00000100:00100000:1.0:1789135825.101402:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294848 00000100:00100000:2.0:1789135825.101461:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723294464:0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.101495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.101514:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789135825.101519:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135825.101540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.101553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723294592:0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.101569:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135825.101639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294464 00000100:00100000:0.0:1789135825.101644:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294464 00000100:00100000:3.0:1789135825.101754:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135825.101764:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723294720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.101802:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723294720:12345-0@lo:400:kworker.0 Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.101807:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135825.101835:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294080 00000100:00100000:3.0:1789135825.101838:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294080 00000100:00100000:3.0:1789135825.101866:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135825.101872:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723294080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135825.101905:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135825.101944:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723294080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.101951:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789135825.102001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76580 x1876044723294080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135825.102030:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135825.107528:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294592 00000100:00100000:3.0:1789135825.107544:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294592 00000100:00100000:1.0:1789135825.107556:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135825.107576:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723294848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.107606:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789135825.107615:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723294592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.107750:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723294592:12345-0@lo:400:kworker.0 Request processed in 135us (6177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.107757:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789135825.107810:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074151680 x1876044723294592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135825.107827:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723294592:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.107869:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723294720:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.107885:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723294336:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.107896:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723294208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.108108:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723294848:12345-0@lo:400:kworker.0 Request processed in 539us (6907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.108116:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789135825.108150:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074151e00 x1876044723294848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135825.108161:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723294848:0@lo:400:kworker.0 00000100:00080000:2.0:1789135825.108929:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135825.108937:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135825.108955:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135825.109427:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135825.109439:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135825.109521:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723294464:12345-0@lo:400:kworker.0 Request processed in 84us (8024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135825.109528:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135825.109783:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723294464:0@lo:400:kworker.0 00000100:00100000:0.0:1789135825.613072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135825.613101:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723294976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135825.613190:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135825.613558:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723294976 00000100:00100000:3.0:1789135825.613566:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723294976 00000100:00100000:3.0:1789135825.613614:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789135825.613623:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723294976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135825.613670:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135825.613748:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723294976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.613755:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789135825.613911:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f743c0 x1876044723294976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135825.613930:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723294976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135825.741514:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135826.766048:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135826.799662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135826.799779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135826.799820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135826.799832:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001664 00000100:00100000:1.0:1789135826.799844:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001664 00000100:00100000:2.0:1789135826.799850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135826.799876:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001536 00000100:00100000:2.0:1789135826.799881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001536 00000100:00100000:1.0:1789135826.799921:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789135826.799932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:1.0:1789135826.799936:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696001664:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135826.799946:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696001536:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135826.800044:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696001536:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135826.800047:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696001664:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135826.800057:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:1.0:1789135826.800066:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00080000:2.0:1789135826.800082:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135826.800088:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135826.800096:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001280 00000100:00100000:1.0:1789135826.800100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001280 00000100:00100000:1.0:1789135826.800131:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00100000:1.0:1789135826.800140:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696001280:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135826.800166:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696001280:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135826.800172:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00100000:0.0:1789135826.800576:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001408 00000100:00100000:0.0:1789135826.800588:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001408 00000100:00100000:1.0:1789135826.800802:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:1.0:1789135826.800810:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696001408:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:2.0:1789135826.800842:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135826.800855:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696001408:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 45us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135826.800863:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00010000:00010000:0.0:1789135827.793352:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135828.827664:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135829.245815:0:8829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789135829.838097:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135830.221011:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723295488:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221078:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221127:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135830.221132:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723295104:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221175:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723295616:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221216:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723295232:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221248:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723295744:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221292:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135830.221297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723295360:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.221338:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295488 00000100:00100000:0.0:1789135830.221344:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295488 00000100:00100000:0.0:1789135830.221400:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295744 00000100:00100000:0.0:1789135830.221402:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295744 00000100:00100000:0.0:1789135830.221420:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135830.221428:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221471:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723295488:12345-0@lo:400:kworker.0 Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.221478:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135830.221502:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135830.221507:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723295744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221534:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723295744:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.221539:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135830.221556:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295616 00000100:00100000:0.0:1789135830.221559:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295616 00000100:00100000:0.0:1789135830.221586:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295232 00000100:00100000:0.0:1789135830.221589:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295232 00000100:00100000:0.0:1789135830.221601:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295360 00000100:00100000:0.0:1789135830.221603:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295360 00000100:00100000:0.0:1789135830.221617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135830.221623:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723295616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221648:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723295616:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.221654:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135830.221663:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135830.221668:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723295232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221686:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723295232:12345-0@lo:400:kworker.0 Request processed in 19us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.221692:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135830.221724:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135830.221730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221750:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723295360:12345-0@lo:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.221756:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789135830.221777:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135830.221786:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135830.221788:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135830.221820:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723295360:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.221829:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723295232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135830.221951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295104 00000100:00100000:1.0:1789135830.221956:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295104 00000100:00100000:1.0:1789135830.221980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789135830.221991:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723295104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135830.222021:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723295104:12345-0@lo:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135830.222026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:0.0:1789135830.224089:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074153480 x1876044723295744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135830.224109:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723295744:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.224145:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135830.224156:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723295872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135830.224214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.224286:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074152940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723295104:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.224299:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723295616:0@lo:400:kworker.0 00010000:00080000:0.0:1789135830.224312:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074150f00 x1876044723295488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135830.224321:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723295488:0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.224484:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723295872 00000100:00100000:3.0:1789135830.224491:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723295872 00000100:00100000:3.0:1789135830.224543:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135830.224554:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723295872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135830.224596:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135830.224669:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723295872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.224677:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789135830.225304:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f77840 x1876044723295872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135830.225321:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723295872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135830.734074:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723296000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135830.734374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.734595:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296000 00000100:00100000:0.0:1789135830.734604:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296000 00000100:00100000:0.0:1789135830.734674:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135830.734683:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723296000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135830.734750:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789135830.735050:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f070c0 x1876044723296000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135830.735071:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723296000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135830.737285:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723296000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2596us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.737300:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789135830.860951:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135831.887292:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135831.924544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135831.924606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135831.924646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002048 00000100:00100000:3.0:1789135831.924658:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002048 00000100:00100000:1.0:1789135831.924854:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002176 00000100:00100000:1.0:1789135831.924859:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002176 00000100:00100000:1.0:1789135831.924932:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:1.0:1789135831.924944:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696002176:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:1.0:1789135831.924994:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95fb6 00000100:00080000:1.0:1789135831.925008:0:8442:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ec800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135831.925062:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789135831.925548:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+2:2362:x1876044696002176:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 604us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135831.925558:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00010000:00010000:1.0:1789135831.925591:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135831.926103:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:3.0:1789135831.926116:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696002048:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:3.0:1789135831.926145:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95faf 00000100:00080000:3.0:1789135831.926154:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789135831.926185:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789135831.926465:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+2:2362:x1876044696002048:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 352us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135831.926473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00080000:3.0:1789135831.926494:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135831.926500:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135831.926536:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135831.926581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135831.926683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135831.926766:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001792 00000100:00100000:3.0:1789135831.926773:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001792 00000100:00100000:3.0:1789135831.926808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 196 00000100:00100000:3.0:1789135831.926815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696001792:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135831.926850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696001792:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135831.926857:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 196 00000100:00100000:3.0:1789135831.926901:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696001920 00000100:00100000:3.0:1789135831.926905:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696001920 00000100:00100000:3.0:1789135831.926945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:3.0:1789135831.926953:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696001920:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135831.926984:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696001920:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135831.926991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00080000:3.0:1789135831.927010:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135832.912876:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135833.932860:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:0.0:1789135833.932870:0:6724:0:(genops.c:885:class_export_put()) final put ffff8b9f46d43000/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:3.0:1789135833.934297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f46d43000/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0000 00000020:00000080:3.0:1789135833.934359:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f46d45000 for lustre-OST0000 00010000:00010000:2.0:1789135833.934504:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135834.958083:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135835.341190:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723296128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135835.341269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135835.341356:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296128 00000100:00100000:1.0:1789135835.341364:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296128 00000100:00100000:1.0:1789135835.341420:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135835.341430:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723296128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135835.341484:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135835.341547:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723296128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135835.341557:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789135835.341575:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789135835.341600:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f77480 x1876044723296128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135835.342170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723296256:0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.342206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135835.342228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723296768:0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.342249:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135835.342265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135835.342269:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723296384:0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.342286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135835.342309:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296768 00000100:00100000:0.0:1789135835.342313:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296768 00000100:00100000:0.0:1789135835.342345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296384 00000100:00100000:0.0:1789135835.342348:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296384 00000100:00100000:0.0:1789135835.342369:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135835.342376:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723296768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.342413:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723296128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135835.342435:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723296640:0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.344611:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135835.344717:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135835.344729:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723296512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.344763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135835.344790:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296256 00000100:00100000:1.0:1789135835.344797:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296256 00000100:00100000:1.0:1789135835.344860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789135835.344869:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723296256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.344925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723296256:12345-0@lo:400:kworker.0 Request processed in 57us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135835.344943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1789135835.345134:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135835.345168:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723296256:0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.346312:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723296768:12345-0@lo:400:kworker.0 Request processed in 3930us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135835.346323:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135835.346349:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296512 00000100:00100000:0.0:1789135835.346355:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296512 00000100:00100000:0.0:1789135835.346388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135835.346395:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723296384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.346448:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723296384:12345-0@lo:400:kworker.0 Request processed in 53us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135835.346454:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135835.346465:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789135835.346472:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723296512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135835.346502:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723296512:12345-0@lo:400:kworker.0 Request processed in 31us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135835.346508:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789135835.346689:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135835.346740:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723296384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.346753:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723296768:0@lo:400:kworker.0 00000100:00100000:1.0:1789135835.346783:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723296512:0@lo:400:kworker.0 00000100:00100000:3.0:1789135835.347143:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296640 00000100:00100000:3.0:1789135835.347149:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296640 00000100:00100000:3.0:1789135835.347253:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135835.347260:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723296640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135835.347312:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723296640:12345-0@lo:400:kworker.0 Request processed in 53us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135835.347318:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789135835.347401:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135835.347426:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f06580 x1876044723296640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135835.347438:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723296640:0@lo:400:kworker.0 00000001:02000400:0.0:1789135835.624512:0:9076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing yml_node 00000100:00100000:0.0:1789135835.858129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135835.858150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723296896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135835.858218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135835.858282:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723296896 00000100:00100000:0.0:1789135835.858289:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723296896 00000100:00100000:0.0:1789135835.858341:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135835.858351:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723296896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135835.858388:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135835.858429:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723296896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135835.858436:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789135835.858474:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f07c00 x1876044723296896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135835.858493:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723296896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135835.984008:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135836.414060:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:1.0:1789135836.414069:0:7663:0:(genops.c:885:class_export_put()) final put ffff8ba0491eb800/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:0.0:1789135836.414385:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0491eb800/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0001 00000020:00000080:0.0:1789135836.414446:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba0491ec800 for lustre-OST0001 00010000:00010000:0.0:1789135837.008303:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135837.050619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135837.050670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135837.050849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002304 00000100:00100000:1.0:1789135837.050862:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002304 00000100:00100000:1.0:1789135837.050927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 198 00000100:00100000:1.0:1789135837.050936:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696002304:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135837.051008:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696002304:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135837.051016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 198 00000100:00100000:0.0:1789135837.051218:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002432 00000100:00100000:0.0:1789135837.051224:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002432 00000100:00100000:0.0:1789135837.051325:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789135837.051334:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696002432:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:1.0:1789135837.051513:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135837.051993:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696002432:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 658us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135837.052002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00010000:00010000:0.0:1789135838.029110:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135839.053058:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135840.032654:0:9268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.127 00010000:00010000:0.0:1789135840.078405:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135840.461019:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135840.461097:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135840.461358:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297024 00000100:00100000:1.0:1789135840.461367:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297024 00000100:00080000:2.0:1789135840.461517:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135840.461560:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135840.461585:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723297024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135840.461620:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135840.461676:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723297024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135840.461684:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789135840.461811:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76940 x1876044723297024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135840.461831:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135840.462209:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723297152:0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135840.462284:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723297664:0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135840.462331:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135840.462337:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723297536:0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462362:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135840.462388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297664 00000100:00100000:3.0:1789135840.462392:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297664 00000100:00100000:3.0:1789135840.462490:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135840.462498:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723297664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462539:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723297664:12345-0@lo:400:kworker.0 Request processed in 42us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135840.462546:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135840.462566:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297536 00000100:00100000:3.0:1789135840.462571:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297536 00000100:00100000:3.0:1789135840.462597:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135840.462605:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723297536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462637:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723297536:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135840.462644:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789135840.462685:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec4f00 x1876044723297536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135840.462696:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723297536:0@lo:400:kworker.0 00000100:00100000:3.0:1789135840.462750:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723297664:0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.462999:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723297408:0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.463038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135840.463059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135840.463064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723297280:0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.463084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789135840.463108:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135840.463112:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135840.463121:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297408 00000100:00100000:2.0:1789135840.463125:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297408 00000100:00100000:2.0:1789135840.463154:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297280 00000100:00100000:2.0:1789135840.463157:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297280 00000100:00100000:2.0:1789135840.463173:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135840.463180:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723297408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.463217:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723297408:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135840.463223:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135840.463237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135840.463243:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723297280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.463269:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723297280:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135840.463274:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789135840.463288:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135840.463308:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723297280:0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.463317:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723297408:0@lo:400:kworker.0 00000100:00100000:1.0:1789135840.463476:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297152 00000100:00100000:1.0:1789135840.463481:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297152 00000100:00100000:1.0:1789135840.463519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789135840.463526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723297152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135840.463573:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723297152:12345-0@lo:400:kworker.0 Request processed in 47us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135840.463579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789135840.463776:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723297152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135840.973869:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723297792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135840.973974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135840.974073:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297792 00000100:00100000:0.0:1789135840.974081:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297792 00000100:00100000:0.0:1789135840.974135:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135840.974145:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723297792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135840.974190:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135840.974241:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723297792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135840.974248:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789135840.974290:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f07c00 x1876044723297792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135840.974309:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723297792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135841.103204:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135842.131394:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135842.163823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135842.163927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135842.163993:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002688 00000100:00100000:1.0:1789135842.164002:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002688 00000100:00100000:1.0:1789135842.164068:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:1.0:1789135842.164078:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696002688:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135842.164174:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696002688:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135842.164182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00080000:1.0:1789135842.164319:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135842.164692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002560 00000100:00100000:0.0:1789135842.164721:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002560 00000100:00100000:0.0:1789135842.164754:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 200 00000100:00100000:0.0:1789135842.164770:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696002560:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135842.164822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696002560:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 53us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135842.164828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 200 00000001:02000400:1.0:1789135842.858500:0:9366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.127 00010000:00010000:0.0:1789135843.161652:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135844.176167:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135845.200751:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135845.581733:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723297920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135845.581824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135845.582088:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723297920 00000100:00100000:0.0:1789135845.582097:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723297920 00000100:00100000:0.0:1789135845.582181:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135845.582190:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723297920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135845.582232:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135845.582291:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723297920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135845.582299:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789135845.582344:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec5e00 x1876044723297920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135845.582363:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723297920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135845.582584:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723298176:0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.582678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135845.582725:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789135845.582731:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723298048:0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.582832:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723298432:0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.582876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135845.582898:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135845.582903:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723298304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.582923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135845.582947:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298432 00000100:00100000:0.0:1789135845.582951:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298432 00000100:00100000:0.0:1789135845.582979:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135845.582985:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723298432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.583037:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723298432:12345-0@lo:400:kworker.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135845.583044:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789135845.583074:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76d00 x1876044723298432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135845.583085:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723298432:0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.583137:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298176 00000100:00100000:0.0:1789135845.583141:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298176 00000100:00100000:0.0:1789135845.583184:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298304 00000100:00100000:0.0:1789135845.583187:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298304 00000100:00100000:0.0:1789135845.583205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135845.583210:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.583243:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723298176:12345-0@lo:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135845.583248:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135845.583259:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135845.583264:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723298304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.583291:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723298304:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135845.583296:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135845.583318:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723298304:0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.583577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135845.583611:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723298560:0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.583653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135845.583678:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723298176:0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.583718:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298560 00000100:00100000:2.0:1789135845.583722:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298560 00000100:00100000:0.0:1789135845.583928:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298048 00000100:00100000:0.0:1789135845.583932:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298048 00000100:00100000:0.0:1789135845.583958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789135845.583965:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723298048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135845.584018:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723298048:12345-0@lo:400:kworker.0 Request processed in 54us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135845.584025:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789135845.584095:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135845.584102:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723298560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.584193:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723298560:12345-0@lo:400:kworker.0 Request processed in 92us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135845.584199:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135845.584226:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723298048:0@lo:400:kworker.0 00000100:00100000:2.0:1789135845.584236:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723298560:0@lo:400:kworker.0 00000100:00080000:1.0:1789135845.585121:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135845.585128:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135845.585131:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135846.093287:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723298688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135846.094248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135846.094534:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298688 00000100:00100000:0.0:1789135846.094550:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298688 00000100:00100000:0.0:1789135846.094664:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135846.094684:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723298688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135846.094788:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135846.094901:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723298688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135846.094909:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789135846.095974:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f06580 x1876044723298688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.096000:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723298688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135846.222253:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135847.085902:0:9464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.127 00010000:00010000:0.0:1789135847.245018:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135847.280923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135847.281042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002816 00000100:00100000:0.0:1789135847.281055:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002816 00000100:00100000:0.0:1789135847.281127:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 202 00000100:00100000:0.0:1789135847.281138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2363:x1876044696002816:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135847.281238:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2363:x1876044696002816:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135847.281247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 202 00000100:00100000:0.0:1789135847.283417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135847.283611:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696002944 00000100:00100000:1.0:1789135847.283622:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696002944 00000100:00100000:1.0:1789135847.283737:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:1.0:1789135847.283748:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696002944:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135847.283844:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696002944:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 98us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135847.283852:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00080000:0.0:1789135847.284074:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135848.270115:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135849.294144:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135850.342552:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135850.558332:0:9513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 10:10:46 EDT 2026 00000100:00100000:0.0:1789135850.701260:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723298816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135850.701333:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.701440:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298816 00000100:00100000:0.0:1789135850.701449:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298816 00000100:00100000:0.0:1789135850.701536:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135850.701546:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723298816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135850.701691:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135850.701766:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723298816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.701773:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789135850.701794:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135850.701820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f04780 x1876044723298816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135850.701838:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723298816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135850.701872:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723299072:0@lo:400:kworker.0 00000100:00100000:1.0:1789135850.701911:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.701933:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723299328:0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.701973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.701997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135850.702006:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723298944:0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.702043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.702070:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723299456:0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.702092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.702134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723298944 00000100:00100000:0.0:1789135850.702138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723298944 00000100:00100000:0.0:1789135850.702171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789135850.702179:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723298944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.702219:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723298944:12345-0@lo:400:kworker.0 Request processed in 41us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.702240:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789135850.702261:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135850.702270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723299200:0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.702284:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723298944:0@lo:400:kworker.0 00000100:00100000:1.0:1789135850.702337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.702765:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299072 00000100:00100000:0.0:1789135850.702770:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299072 00000100:00100000:1.0:1789135850.702796:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299456 00000100:00100000:1.0:1789135850.702800:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299456 00000100:00100000:0.0:1789135850.702804:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299200 00000100:00100000:0.0:1789135850.702807:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299200 00000100:00100000:0.0:1789135850.702828:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135850.702835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723299072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135850.702865:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299328 00000100:00100000:3.0:1789135850.702871:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299328 00000100:00100000:0.0:1789135850.703023:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723299072:12345-0@lo:400:kworker.0 Request processed in 186us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.703030:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135850.703050:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135850.703059:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723299200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.703097:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723299200:12345-0@lo:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.703105:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789135850.703596:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135850.703601:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135850.703630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135850.703638:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135850.703688:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723299456:12345-0@lo:400:kworker.0 Request processed in 51us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135850.703696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789135850.703720:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135850.703731:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723299328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135850.703765:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723299200:0@lo:400:kworker.0 00000100:00100000:3.0:1789135850.703776:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723299328:12345-0@lo:400:kworker.0 Request processed in 48us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135850.703784:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723299072:0@lo:400:kworker.0 00000100:00100000:0.0:1789135850.703792:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723299456:0@lo:400:kworker.0 00000100:00100000:3.0:1789135850.703800:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789135850.703811:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec61c0 x1876044723299328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135850.703823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723299328:0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.214956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135851.215094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723299584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135851.215189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.216245:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299584 00000100:00100000:0.0:1789135851.216261:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299584 00000100:00100000:0.0:1789135851.217121:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135851.217137:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723299584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135851.217182:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135851.217273:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723299584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.217294:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789135851.217377:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f05680 x1876044723299584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.217402:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723299584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135851.344372:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135852.366875:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135852.400107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135852.400216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135852.400332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003072 00000100:00100000:3.0:1789135852.400344:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003072 00000100:00100000:3.0:1789135852.400406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00100000:3.0:1789135852.400417:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696003072:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135852.400529:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696003072:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.400538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00100000:1.0:1789135852.404367:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003200 00000100:00100000:1.0:1789135852.404385:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003200 00000100:00100000:1.0:1789135852.404484:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:1.0:1789135852.404505:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696003200:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135852.404601:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696003200:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 98us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135852.404609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00080000:0.0:1789135852.405057:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135853.389779:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135854.431793:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135855.437184:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135855.821171:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135855.821253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135855.821958:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723300096:0@lo:400:kworker.0 00000100:00100000:2.0:1789135855.822059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135855.822082:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135855.822088:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723300224:0@lo:400:kworker.0 00000100:00100000:2.0:1789135855.822113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.822310:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723299840:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.822382:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723300352:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822404:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.822445:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135855.822451:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723299968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.822534:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300096 00000100:00100000:1.0:1789135855.822540:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300096 00000100:00100000:1.0:1789135855.822592:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300352 00000100:00100000:1.0:1789135855.822595:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300352 00000100:00100000:1.0:1789135855.822608:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299968 00000100:00100000:1.0:1789135855.822610:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299968 00000100:00100000:1.0:1789135855.822643:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135855.822650:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723300096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822723:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723300096:12345-0@lo:400:kworker.0 Request processed in 50us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135855.822731:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135855.822747:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135855.822754:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723300352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822788:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723300352:12345-0@lo:400:kworker.0 Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135855.822793:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135855.822805:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135855.822810:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.822848:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723299968:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135855.822855:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789135855.822876:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135855.823111:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723299968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.823125:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723300352:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.823167:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723300096:0@lo:400:kworker.0 00000100:00100000:2.0:1789135855.823378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299840 00000100:00100000:2.0:1789135855.823382:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299840 00000100:00100000:2.0:1789135855.823439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789135855.823447:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723299840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135855.823487:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723299840:12345-0@lo:400:kworker.0 Request processed in 41us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135855.823494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789135855.823666:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723299712 00000100:00100000:0.0:1789135855.823670:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723299712 00000100:00100000:0.0:1789135855.823740:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135855.823748:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723299712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135855.823777:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135855.823816:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723299712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135855.823822:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135855.823858:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300224 00000100:00100000:0.0:1789135855.823862:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300224 00000100:00100000:0.0:1789135855.823889:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135855.823906:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723300224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135855.823941:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723300224:12345-0@lo:400:kworker.0 Request processed in 47us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135855.823948:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789135855.824237:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135855.824241:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135855.826198:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723299840:0@lo:400:kworker.0 00010000:00080000:1.0:1789135855.826249:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f06580 x1876044723299712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135855.826270:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723299712:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789135855.826298:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9a40 x1876044723300224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135855.826308:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723300224:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.333309:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135856.333390:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135856.333795:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300480 00000100:00100000:0.0:1789135856.333803:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300480 00000100:00100000:0.0:1789135856.333856:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135856.333865:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723300480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135856.333911:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135856.333963:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723300480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.333983:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789135856.334280:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f05680 x1876044723300480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135856.334300:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723300480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135856.460956:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135857.492812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135857.521901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135857.521960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135857.522069:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003456 00000100:00100000:1.0:1789135857.522079:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003456 00000100:00100000:1.0:1789135857.522153:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:1.0:1789135857.522163:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696003456:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135857.522230:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696003456:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135857.522239:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00080000:3.0:1789135857.522279:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135857.522570:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003328 00000100:00100000:2.0:1789135857.522576:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003328 00000100:00100000:2.0:1789135857.522612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 206 00000100:00100000:2.0:1789135857.522619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696003328:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135857.522646:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696003328:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 27us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135857.522652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 206 00010000:00010000:2.0:1789135858.508950:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135859.535064:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135860.556881:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135860.942185:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135860.942212:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135860.942283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135860.942413:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300608 00000100:00100000:0.0:1789135860.942422:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300608 00000100:00100000:0.0:1789135860.942490:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135860.942500:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723300608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135860.942534:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135860.942581:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723300608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135860.942589:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789135860.942786:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789135860.942815:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f06580 x1876044723300608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135860.942833:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135860.944123:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723300992:0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944184:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135860.944218:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135860.944224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723300864:0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135860.944273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723300736:0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135860.944349:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723301248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944372:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135860.944389:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135860.944395:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723301120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135860.944460:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301120 00000100:00100000:3.0:1789135860.944466:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301120 00000100:00100000:3.0:1789135860.944527:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135860.944536:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723301120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135860.944586:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723301120:12345-0@lo:400:kworker.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135860.944594:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789135860.944620:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135860.944648:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76940 x1876044723301120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135860.944662:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723301120:0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.945584:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300992 00000100:00100000:1.0:1789135860.945591:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300992 00000100:00100000:1.0:1789135860.945645:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300864 00000100:00100000:1.0:1789135860.945648:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300864 00000100:00100000:1.0:1789135860.945659:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301248 00000100:00100000:1.0:1789135860.945661:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301248 00000100:00100000:1.0:1789135860.945675:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135860.945682:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723300992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.945787:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723300992:12345-0@lo:400:kworker.0 Request processed in 105us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135860.945801:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135860.945817:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135860.945824:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723300864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.945857:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723300864:12345-0@lo:400:kworker.0 Request processed in 33us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135860.945863:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135860.945876:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135860.945882:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723301248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.945918:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723301248:12345-0@lo:400:kworker.0 Request processed in 36us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135860.945924:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135860.945947:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723300736 00000100:00100000:1.0:1789135860.945950:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723300736 00000100:00100000:1.0:1789135860.945976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789135860.945982:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.946016:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723300736:12345-0@lo:400:kworker.0 Request processed in 34us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135860.946023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789135860.946078:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723300864:0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.946090:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723300992:0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.946117:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723300736:0@lo:400:kworker.0 00000100:00100000:1.0:1789135860.946129:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723301248:0@lo:400:kworker.0 00000100:00080000:3.0:1789135860.947742:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135861.453553:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723301376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135861.453647:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.453809:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301376 00000100:00100000:0.0:1789135861.453818:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301376 00000100:00100000:0.0:1789135861.453924:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135861.453935:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723301376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135861.454059:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135861.454131:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723301376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.454138:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789135861.454346:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073f76d00 x1876044723301376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135861.454366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723301376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135861.582724:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135862.605494:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135862.642273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135862.642338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135862.642548:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003712 00000100:00100000:0.0:1789135862.642548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003584 00000100:00100000:1.0:1789135862.642562:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003712 00000100:00100000:0.0:1789135862.642563:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003584 00000100:00100000:0.0:1789135862.642628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 208 00000100:00100000:1.0:1789135862.642638:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:0.0:1789135862.642644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696003584:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135862.642654:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696003712:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:3.0:1789135862.642773:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135862.642861:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2365:x1876044696003584:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 222us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135862.642889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 208 00000100:00100000:1.0:1789135862.650613:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696003712:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 7946us (8255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135862.650634:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00010000:00010000:3.0:1789135863.633103:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135864.671527:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135865.680628:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135866.061068:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723301632:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135866.061302:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723302144:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061342:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135866.061409:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135866.061415:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723301760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061441:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135866.061483:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301632 00000100:00100000:0.0:1789135866.061493:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301632 00000100:00100000:0.0:1789135866.061567:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301760 00000100:00100000:0.0:1789135866.061571:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301760 00000100:00100000:0.0:1789135866.061612:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135866.061622:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074152940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723301632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061729:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074152940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723301632:12345-0@lo:400:kworker.0 Request processed in 79us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.061737:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135866.061762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135866.061768:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061797:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723301760:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.061803:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135866.061829:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302144 00000100:00100000:0.0:1789135866.061833:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302144 00000100:00100000:0.0:1789135866.061860:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135866.061866:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723302144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061911:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723302144:12345-0@lo:400:kworker.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.061919:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135866.061978:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723301760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.061990:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723301632:0@lo:400:kworker.0 00010000:00080000:0.0:1789135866.062001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0741503c0 x1876044723302144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135866.062011:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723302144:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064143:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723301504:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.064293:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723302016:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.064518:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135866.064527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723301888:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789135866.064597:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135866.064604:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135866.064665:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301504 00000100:00100000:3.0:1789135866.064672:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301504 00000100:00100000:3.0:1789135866.064741:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135866.064752:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723301504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064804:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723301504:12345-0@lo:400:kworker.0 Request processed in 53us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.064811:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135866.064849:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723301888 00000100:00100000:3.0:1789135866.064853:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723301888 00000100:00100000:3.0:1789135866.064888:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135866.064895:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723301888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.064929:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723301888:12345-0@lo:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.064936:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135866.065200:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723302272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135866.065254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135866.065288:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302272 00000100:00100000:0.0:1789135866.065291:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302272 00000100:00100000:0.0:1789135866.065318:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135866.065324:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723302272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135866.065371:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135866.065548:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723302272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 222us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.065555:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789135866.065593:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c099680 x1876044723302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135866.065614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723302272:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789135866.065674:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135866.067145:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074150780 x1876044723301888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135866.067177:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723301888:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.067191:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723301504:0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.067268:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302016 00000100:00100000:0.0:1789135866.067276:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302016 00000100:00100000:0.0:1789135866.067341:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135866.067362:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723302016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135866.067517:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723302016:12345-0@lo:400:kworker.0 Request processed in 167us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.067525:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135866.067569:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723302016:0@lo:400:kworker.0 00000100:00080000:3.0:1789135866.072222:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135866.592965:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723302400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135866.593565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.604137:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302400 00000100:00100000:1.0:1789135866.604165:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302400 00000100:00100000:1.0:1789135866.604348:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135866.604362:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723302400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135866.604441:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135866.604587:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723302400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135866.604604:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789135866.610868:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9e00 x1876044723302400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135866.610906:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723302400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135866.706119:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135867.728284:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135867.762022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135867.762098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135867.762332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003968 00000100:00100000:1.0:1789135867.762345:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003968 00000100:00100000:1.0:1789135867.762436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:1.0:1789135867.762448:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696003968:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135867.762552:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696003968:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 106us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135867.762581:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00080000:0.0:1789135867.762919:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135867.763484:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696003840 00000100:00100000:3.0:1789135867.763502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696003840 00000100:00100000:3.0:1789135867.763620:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 210 00000100:00100000:3.0:1789135867.763630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696003840:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135867.763694:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696003840:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 65us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135867.763725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 210 00010000:00010000:2.0:1789135868.752881:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135869.774413:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135870.807996:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135871.180974:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135871.181082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135871.181196:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302528 00000100:00100000:0.0:1789135871.181206:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302528 00000100:00100000:0.0:1789135871.181292:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135871.181302:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723302528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135871.181342:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135871.181392:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723302528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135871.181400:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789135871.181440:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135871.181472:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074150780 x1876044723302528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135871.181491:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723302528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135871.181937:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723302656:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.181979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135871.182016:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723303168:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.182044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135871.182065:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135871.182071:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723302784:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.182096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135871.182123:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303168 00000100:00100000:0.0:1789135871.182126:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303168 00000100:00100000:0.0:1789135871.182176:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302784 00000100:00100000:0.0:1789135871.182180:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302784 00000100:00100000:0.0:1789135871.182201:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135871.182208:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723303168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.182335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302656 00000100:00100000:1.0:1789135871.182340:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302656 00000100:00100000:1.0:1789135871.182371:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789135871.182378:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723302656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.182415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723302656:12345-0@lo:400:kworker.0 Request processed in 38us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.182422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789135871.182812:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135871.182825:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723302784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.182866:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723302784:12345-0@lo:400:kworker.0 Request processed in 44us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.182872:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135871.182901:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723302912:0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.182928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135871.182949:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135871.182956:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723303040:0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.182983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135871.183011:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723302912 00000100:00100000:1.0:1789135871.183016:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723302912 00000100:00100000:1.0:1789135871.183038:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135871.183045:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723302912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.183078:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723302912:12345-0@lo:400:kworker.0 Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.183084:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135871.183157:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723302912:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.183297:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723303168:12345-0@lo:400:kworker.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135871.183309:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135871.183338:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303040 00000100:00100000:0.0:1789135871.183341:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303040 00000100:00100000:0.0:1789135871.183385:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135871.183393:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723303040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.183433:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723303040:12345-0@lo:400:kworker.0 Request processed in 42us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135871.183449:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789135871.183468:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135871.183473:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135871.183496:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec5e00 x1876044723303040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135871.183508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723303040:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.183534:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723302784:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.183544:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723302656:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.183556:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723303168:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.693385:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723303296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135871.693644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.693874:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303296 00000100:00100000:2.0:1789135871.693883:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303296 00000100:00100000:2.0:1789135871.693943:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135871.693952:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723303296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135871.693996:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135871.694059:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723303296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.694067:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789135871.694254:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce92c0 x1876044723303296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.694274:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723303296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135871.822210:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135872.845643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135872.884184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135872.884259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135872.884344:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004224 00000100:00100000:1.0:1789135872.884370:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004224 00000100:00100000:1.0:1789135872.884465:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00100000:1.0:1789135872.884476:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696004224:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135872.884596:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696004224:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 121us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135872.884605:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00080000:0.0:1789135872.884882:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135872.885420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004096 00000100:00100000:3.0:1789135872.885427:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004096 00000100:00100000:3.0:1789135872.885476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 212 00000100:00100000:3.0:1789135872.885485:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2366:x1876044696004096:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135872.886161:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2366:x1876044696004096:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 671us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135872.886173:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 212 00010000:00010000:3.0:1789135873.869556:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.898037:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135875.009134:0:10145:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:11:11 (1789135871) === 00000100:00100000:0.0:1789135875.368683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.368980:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004352 00000100:00100000:1.0:1789135875.368993:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004352 00000100:00100000:1.0:1789135875.369202:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 213 00000100:00100000:1.0:1789135875.369213:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:8155:x1876044696004352:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789135875.369245:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135875.369270:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf9607a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fe86 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.369306:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf9607a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe86 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.369317:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf9607a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe86 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.369328:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9400, rc 0) 00000100:00100000:1.0:1789135875.369418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004352:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 206us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.369426:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 213 00000100:00100000:0.0:1789135875.371313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135875.372847:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004480 00000100:00100000:3.0:1789135875.372862:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004480 00000100:00100000:3.0:1789135875.372940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 214 00000100:00100000:3.0:1789135875.372950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004480:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789135875.373326:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004480:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 376us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.373347:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 214 00000100:00100000:2.0:1789135875.384532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135875.384748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004608 00000100:00100000:3.0:1789135875.384761:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004608 00000100:00100000:3.0:1789135875.384822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 215 00000100:00100000:3.0:1789135875.384833:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004608:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789135875.385198:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004608:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 365us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.385207:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 215 00000100:00100000:2.0:1789135875.399624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.400149:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004736 00000100:00100000:1.0:1789135875.400196:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004736 00000100:00100000:1.0:1789135875.401484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 216 00000100:00100000:1.0:1789135875.401503:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8159:x1876044696004736:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135875.405957:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8159:x1876044696004736:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 4433us (6317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.405980:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 216 00000100:00100000:1.0:1789135875.423548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135875.426780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004864 00000100:00100000:0.0:1789135875.426800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004864 00000100:00100000:0.0:1789135875.426898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 217 00000100:00100000:0.0:1789135875.426910:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8159:x1876044696004864:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135875.427612:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8159:x1876044696004864:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 700us (4071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135875.427635:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 217 00000100:00100000:2.0:1789135875.440473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.440993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696004992 00000100:00100000:1.0:1789135875.441005:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696004992 00000100:00100000:1.0:1789135875.441092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 218 00000100:00100000:1.0:1789135875.441103:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:8155:x1876044696004992:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789135875.441124:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135875.441146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf96081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62feb0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.441179:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf96081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.441192:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf96081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.441203:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9200, rc 0) 00000100:00100000:1.0:1789135875.441690:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:8155:x1876044696004992:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 587us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.441742:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 218 00000100:00100000:2.0:1789135875.451875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135875.452066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005120 00000100:00100000:0.0:1789135875.452077:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005120 00000100:00100000:0.0:1789135875.452143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 219 00000100:00100000:0.0:1789135875.452155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:8155:x1876044696005120:12345-192.168.204.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789135875.452184:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789135875.452211:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789135875.452216:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789135875.452219:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789135875.452222:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789135875.456923:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:8155:x1876044696005120:12345-192.168.204.41@tcp:256:mount.lustre.0 Request processed in 4675us (4979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.456945:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 219 00000100:00100000:2.0:1789135875.470662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.471333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005248 00000100:00100000:1.0:1789135875.471347:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005248 00000100:00100000:1.0:1789135875.471511:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 220 00000100:00100000:1.0:1789135875.471524:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:8155:x1876044696005248:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789135875.471547:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135875.471570:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62feb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.471609:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.471620:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.471630:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9a00, rc 0) 00000100:00100000:1.0:1789135875.471728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8155:x1876044696005248:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 180us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.471736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 220 00000100:00100000:2.0:1789135875.487239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135875.489331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005376 00000100:00100000:3.0:1789135875.489354:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005376 00000100:00100000:3.0:1789135875.489457:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 221 00000100:00100000:3.0:1789135875.489470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8155:x1876044696005376:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789135875.489978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8155:x1876044696005376:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 508us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.489990:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 221 00000100:00100000:0.0:1789135875.499184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.499329:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005504 00000100:00100000:1.0:1789135875.499348:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005504 00000100:00100000:1.0:1789135875.499445:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 222 00000100:00100000:1.0:1789135875.499458:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8155:x1876044696005504:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789135875.499849:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8155:x1876044696005504:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 392us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.499860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 222 00000100:00100000:2.0:1789135875.506881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135875.507258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005632 00000100:00100000:3.0:1789135875.507272:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005632 00000100:00100000:3.0:1789135875.507370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 223 00000100:00100000:3.0:1789135875.507383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8163:x1876044696005632:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135875.507851:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8163:x1876044696005632:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 469us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.507871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 223 00000100:00100000:2.0:1789135875.516452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135875.518742:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005760 00000100:00100000:3.0:1789135875.518760:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005760 00000100:00100000:3.0:1789135875.518860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 224 00000100:00100000:3.0:1789135875.518873:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8163:x1876044696005760:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135875.519555:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:8163:x1876044696005760:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 682us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.519566:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 224 00000100:00100000:0.0:1789135875.530162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.530296:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006016 00000100:00100000:1.0:1789135875.530307:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006016 00000100:00100000:1.0:1789135875.530403:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:1.0:1789135875.530415:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696006016:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135875.530557:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696006016:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 144us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.530566:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00080000:0.0:1789135875.531093:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135875.550271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.550464:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696005888 00000100:00100000:1.0:1789135875.550478:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696005888 00000100:00100000:1.0:1789135875.550551:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:1.0:1789135875.550561:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1876044696005888:12345-192.168.204.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789135875.550605:0:8031:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 91a64b89-0f15-49f3-b3dc-09d2b2283f2e@192.168.204.41@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1789135875.550660:0:8031:0:(genops.c:1385:class_connect()) connect: client 91a64b89-0f15-49f3-b3dc-09d2b2283f2e, cookie 0x38eb79866bf9608f 00000004:00100000:1.0:1789135875.550743:0:8031:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789135875.551119:0:8031:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d43000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135875.551230:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2362:x1876044696005888:12345-192.168.204.41@tcp:38:mount.lustre.0 Request processed in 667us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.551240:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:0.0:1789135875.581282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.581440:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006144 00000100:00100000:1.0:1789135875.581454:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006144 00000100:00100000:1.0:1789135875.581554:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:1.0:1789135875.581569:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:0:x1876044696006144:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789135875.581655:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789135875.581890:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:0:x1876044696006144:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 325us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.581898:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00080000:0.0:1789135875.582462:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135875.596480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.596653:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006272 00000100:00100000:1.0:1789135875.596666:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006272 00000100:00100000:1.0:1789135875.596779:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:1.0:1789135875.596791:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006272:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789135875.596872:0:8031:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789135875.596981:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006272:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 192us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.596991:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:2.0:1789135875.605133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135875.605265:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006400 00000100:00100000:0.0:1789135875.605281:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006400 00000100:00100000:0.0:1789135875.605372:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:0.0:1789135875.605385:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006400:12345-192.168.204.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789135875.605503:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006400:12345-192.168.204.41@tcp:40:mount.lustre.0 Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135875.605512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789135875.623378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135875.623426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135875.623454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135875.624792:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006528 00000100:00100000:1.0:1789135875.624813:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006528 00000100:00100000:1.0:1789135875.624904:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006656 00000100:00100000:1.0:1789135875.624909:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006656 00000100:00100000:1.0:1789135875.624946:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:1.0:1789135875.624959:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1876044696006528:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789135875.625020:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 91a64b89-0f15-49f3-b3dc-09d2b2283f2e@192.168.204.41@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1789135875.625096:0:6697:0:(genops.c:1385:class_connect()) connect: client 91a64b89-0f15-49f3-b3dc-09d2b2283f2e, cookie 0x38eb79866bf96096 00002000:00100000:1.0:1789135875.625112:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 91a64b89-0f15-49f3-b3dc-09d2b2283f2e/ffff8b9f46d41000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135875.625143:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135875.625614:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789135875.625664:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135875.625803:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2362:x1876044696006528:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 844us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.625814:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:1.0:1789135875.625848:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:1.0:1789135875.625855:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1876044696006656:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789135875.625877:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 91a64b89-0f15-49f3-b3dc-09d2b2283f2e@192.168.204.41@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1789135875.625902:0:6697:0:(genops.c:1385:class_connect()) connect: client 91a64b89-0f15-49f3-b3dc-09d2b2283f2e, cookie 0x38eb79866bf9609d 00002000:00100000:1.0:1789135875.625910:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 91a64b89-0f15-49f3-b3dc-09d2b2283f2e/ffff8b9f4724a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135875.625942:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135875.626107:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789135875.626126:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135875.626155:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2362:x1876044696006656:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 299us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.626163:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:0.0:1789135875.627613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006784 00000100:00100000:0.0:1789135875.627630:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006784 00000100:00100000:0.0:1789135875.627758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:0.0:1789135875.627770:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006784:12345-192.168.204.41@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789135875.628293:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789135875.628494:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:8155:x1876044696006784:12345-192.168.204.41@tcp:33:mount.lustre.0 Request processed in 723us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135875.628504:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00010000:00010000:3.0:1789135875.920661:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135876.301423:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135876.301446:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723303424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135876.301562:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135876.301809:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303424 00000100:00100000:0.0:1789135876.301818:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303424 00000100:00100000:0.0:1789135876.301889:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135876.301900:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723303424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135876.301923:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135876.301972:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723303424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135876.301980:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789135876.302020:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0739dcb40 x1876044723303424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135876.302050:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723303424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789135876.302769:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135876.303384:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723303680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.303444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135876.303500:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135876.303507:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723303808:0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.303566:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135876.303610:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303680 00000100:00100000:3.0:1789135876.303617:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303680 00000100:00100000:3.0:1789135876.303659:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303808 00000100:00100000:3.0:1789135876.303663:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303808 00000100:00100000:3.0:1789135876.303693:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135876.303730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723303680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.303799:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723303680:12345-0@lo:400:kworker.0 Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135876.304148:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135876.304179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135876.304188:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723303808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.304239:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723303808:12345-0@lo:400:kworker.0 Request processed in 53us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135876.304246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789135876.304267:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135876.304303:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723303808:0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.304314:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723303680:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.304499:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723303552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.305054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135876.305101:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723304064:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.305131:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135876.305218:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135876.305225:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723303936:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.305251:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135876.305280:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304064 00000100:00100000:0.0:1789135876.305286:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304064 00000100:00100000:0.0:1789135876.305327:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789135876.305344:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723304064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.305385:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723304064:12345-0@lo:400:kworker.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135876.305391:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789135876.305407:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135876.305428:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723304064:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.305448:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303936 00000100:00100000:0.0:1789135876.305451:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303936 00000100:00100000:0.0:1789135876.306252:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135876.306263:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723303936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.306327:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723303936:12345-0@lo:400:kworker.0 Request processed in 67us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135876.306333:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789135876.306352:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135876.306978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723303552 00000100:00100000:3.0:1789135876.306985:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723303552 00000100:00100000:3.0:1789135876.307026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789135876.307046:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723303552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.307094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723303552:12345-0@lo:400:kworker.0 Request processed in 60us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135876.307100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00080000:2.0:1789135876.307219:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9a40 x1876044723303936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135876.307236:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723303936:0@lo:400:kworker.0 00000100:00100000:2.0:1789135876.307247:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723303552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135876.838995:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135876.839096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135876.839407:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304192 00000100:00100000:2.0:1789135876.839417:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304192 00000100:00100000:2.0:1789135876.839499:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135876.839511:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135876.839545:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135876.839620:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135876.839628:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789135876.839769:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce8b40 x1876044723304192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135876.839793:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135876.942981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789135877.425162:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000001:00100000:0.0:1789135877.512146:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00010000:00010000:1.0:1789135877.966847:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135878.990669:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135879.940129:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00010000:00010000:1.0:1789135880.013296:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135881.036982:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135881.071760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135881.072472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696006912 00000100:00100000:3.0:1789135881.072483:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696006912 00000100:00100000:3.0:1789135881.072551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 226 00000100:00100000:3.0:1789135881.072561:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696006912:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135881.072646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696006912:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 86us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135881.072653:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 226 00000100:00100000:1.0:1789135881.084603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135881.084648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135881.084788:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007040 00000100:00100000:0.0:1789135881.084800:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007040 00000100:00100000:0.0:1789135881.085245:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007168 00000100:00100000:0.0:1789135881.085250:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007168 00000100:00100000:0.0:1789135881.085282:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:0.0:1789135881.085306:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696007040:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135881.085399:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696007040:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 95us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.085407:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:0.0:1789135881.085428:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:0.0:1789135881.085435:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007168:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135881.085462:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007168:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.085469:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:1.0:1789135881.086731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135881.086767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00080000:2.0:1789135881.086963:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135881.087635:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007424 00000100:00100000:0.0:1789135881.087649:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007424 00000100:00100000:0.0:1789135881.087766:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007296 00000100:00100000:0.0:1789135881.087770:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007296 00000100:00100000:0.0:1789135881.087793:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:0.0:1789135881.087802:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007424:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135881.087870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:3.0:1789135881.087896:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007296:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135881.087970:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007296:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 76us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135881.087977:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:0.0:1789135881.088302:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007424:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 499us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.088310:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00080000:2.0:1789135881.091483:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135881.091498:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135881.421203:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135881.421239:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135881.421348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.421442:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304320 00000100:00100000:0.0:1789135881.421451:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304320 00000100:00100000:0.0:1789135881.421536:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135881.421547:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135881.421617:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135881.421676:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.421685:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789135881.421743:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135881.421792:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0739dd2c0 x1876044723304320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135881.421814:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135881.422376:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723304576:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.422458:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789135881.422464:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723304448:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.422522:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723304960:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422544:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.422574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304448 00000100:00100000:0.0:1789135881.422579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304448 00000100:00100000:0.0:1789135881.422614:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789135881.422622:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723304448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422669:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723304448:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.422676:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789135881.422742:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304576 00000100:00100000:0.0:1789135881.422747:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304576 00000100:00100000:0.0:1789135881.422774:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304960 00000100:00100000:0.0:1789135881.422788:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304960 00000100:00100000:0.0:1789135881.422822:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135881.422829:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723304576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422864:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723304576:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.422871:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135881.422885:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789135881.422893:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723304960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.422921:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723304960:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.422928:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789135881.422956:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135881.422986:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723304448:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.423001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723304960:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.423009:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723304576:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.423037:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723304704:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.423923:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.424015:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135881.424025:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304832:0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.424087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135881.424301:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304832 00000100:00100000:2.0:1789135881.424310:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304832 00000100:00100000:2.0:1789135881.424384:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135881.424395:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135881.424464:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723304832:12345-0@lo:400:kworker.0 Request processed in 70us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135881.424473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789135881.427915:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135881.428041:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0739ded00 x1876044723304832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135881.428080:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723304832:0@lo:400:kworker.0 00000100:00100000:1.0:1789135881.433964:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723304704 00000100:00100000:1.0:1789135881.433987:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723304704 00000100:00080000:2.0:1789135881.443259:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135881.443356:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135881.443376:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723304704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135881.443558:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723304704:12345-0@lo:400:kworker.0 Request processed in 189us (19636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.443568:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789135881.443663:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723304704:0@lo:400:kworker.0 00000100:00100000:1.0:1789135881.934360:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135881.934402:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723305088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135881.934534:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.934833:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305088 00000100:00100000:0.0:1789135881.934844:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305088 00000100:00100000:0.0:1789135881.935957:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135881.935985:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723305088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135881.936072:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135881.936203:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723305088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.936212:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789135881.936357:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce8b40 x1876044723305088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135881.936390:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723305088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135882.066176:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135882.254811:0:10342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789135883.086810:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135884.114123:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135885.133767:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135886.157780:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135886.192448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135886.192488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135886.192518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135886.192535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135886.192555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135886.192587:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007680 00000100:00100000:3.0:1789135886.192599:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007680 00000100:00100000:3.0:1789135886.192663:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007808 00000100:00100000:3.0:1789135886.192666:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007808 00000100:00100000:3.0:1789135886.192696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:3.0:1789135886.192733:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696007680:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135886.192826:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696007680:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135886.192835:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:3.0:1789135886.192868:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:3.0:1789135886.192875:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007808:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135886.192902:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007808:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135886.192908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:3.0:1789135886.192929:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007936 00000100:00100000:3.0:1789135886.192932:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007936 00000100:00100000:3.0:1789135886.192981:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008064 00000100:00100000:3.0:1789135886.192986:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008064 00000100:00100000:3.0:1789135886.193006:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:3.0:1789135886.193014:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007936:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135886.193045:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696007936:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135886.193051:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:3.0:1789135886.193062:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:3.0:1789135886.193068:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696008064:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135886.193091:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696008064:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 23us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135886.193097:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:2.0:1789135886.193992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696007552 00000100:00100000:2.0:1789135886.194001:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696007552 00000100:00100000:2.0:1789135886.194051:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 228 00000100:00100000:2.0:1789135886.194059:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696007552:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135886.194111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696007552:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 52us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135886.194117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 228 00000100:00080000:2.0:1789135886.194163:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135886.194169:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135886.194172:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135886.541038:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723305216:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.541122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.541184:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135886.541191:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0412aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723305344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135886.541222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.541270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305216 00000100:00100000:0.0:1789135886.541278:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305216 00000100:00100000:0.0:1789135886.541323:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789135886.541331:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723305216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.541393:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723305216:12345-0@lo:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135886.541401:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789135886.541827:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305344 00000100:00100000:0.0:1789135886.541832:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305344 00000100:00100000:0.0:1789135886.541882:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135886.541889:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723305344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135886.541916:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135886.541949:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723305344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135886.541955:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789135886.541974:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135886.542006:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0412aa580 x1876044723305344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135886.542024:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0412aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723305344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135886.542034:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723305216:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542261:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723305472:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.542315:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135886.542321:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723305600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.542373:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305472 00000100:00100000:0.0:1789135886.542377:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305472 00000100:00100000:0.0:1789135886.542403:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305600 00000100:00100000:0.0:1789135886.542406:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305600 00000100:00100000:0.0:1789135886.542456:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789135886.542462:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723305472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542498:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723305472:12345-0@lo:400:kworker.0 Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135886.542505:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789135886.542516:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135886.542522:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723305600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542548:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723305600:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135886.542554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789135886.542589:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135886.542610:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723305600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542618:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723305472:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723305728:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.542717:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305728 00000100:00100000:0.0:1789135886.542721:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305728 00000100:00100000:0.0:1789135886.542751:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135886.542757:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723305728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.542793:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723305728:12345-0@lo:400:kworker.0 Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135886.542799:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789135886.542814:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135886.542828:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec4000 x1876044723305728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135886.542861:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723305728:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.546901:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135886.546936:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723305856:0@lo:400:kworker.0 00000100:00100000:0.0:1789135886.547101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135886.547203:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305856 00000100:00100000:1.0:1789135886.547209:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305856 00000100:00100000:1.0:1789135886.547313:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135886.547323:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723305856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135886.547391:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723305856:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135886.547399:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789135886.552079:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135886.552162:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723305856:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.053071:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135887.053163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135887.053357:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723305984 00000100:00100000:1.0:1789135887.053368:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723305984 00000100:00100000:1.0:1789135887.053451:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135887.053464:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723305984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135887.053513:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135887.056395:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723305984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2924us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135887.056497:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789135887.057390:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9680 x1876044723305984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135887.057416:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723305984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135887.181109:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135888.205445:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135889.228907:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135890.253377:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135891.278038:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135891.317278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135891.317332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135891.317346:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008192 00000100:00100000:3.0:1789135891.317356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135891.317359:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008192 00000100:00100000:3.0:1789135891.317377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135891.317400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135891.317420:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008704 00000100:00100000:1.0:1789135891.317422:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 230 00000100:00100000:3.0:1789135891.317423:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008704 00000100:00100000:1.0:1789135891.317431:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696008192:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135891.317457:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008576 00000100:00100000:3.0:1789135891.317460:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008576 00000100:00100000:3.0:1789135891.317501:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:1.0:1789135891.317501:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696008192:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135891.317508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 230 00000100:00100000:3.0:1789135891.317509:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008704:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135891.317536:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008704:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.317558:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:3.0:1789135891.317571:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:3.0:1789135891.317578:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008576:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135891.317602:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008576:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.317607:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:3.0:1789135891.317626:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008448 00000100:00100000:3.0:1789135891.317629:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008448 00000100:00080000:0.0:1789135891.319609:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135891.319621:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135891.319624:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135891.323995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008320 00000100:00100000:3.0:1789135891.324015:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008320 00000100:00100000:2.0:1789135891.334777:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:2.0:1789135891.334816:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008448:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135891.334957:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696008448:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 160us (17622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.334965:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:2.0:1789135891.335001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:2.0:1789135891.335009:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696008320:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135891.335037:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696008320:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 30us (17659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.335044:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00080000:3.0:1789135891.338742:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135891.664126:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135891.664156:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723306112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135891.664256:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135891.664354:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306112 00000100:00100000:0.0:1789135891.664361:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306112 00000100:00100000:0.0:1789135891.664432:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135891.664445:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723306112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135891.664485:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135891.664531:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723306112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135891.664554:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789135891.664596:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0739dc000 x1876044723306112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135891.664612:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723306112:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789135891.664641:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135891.668083:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723306240:0@lo:400:kworker.0 00000100:00100000:3.0:1789135891.668620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135891.668692:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135891.668726:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723306368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135891.669155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135891.669391:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135891.669455:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723306752:0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.671506:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723306496:0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.671589:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723306624:0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.671619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135891.672180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306240 00000100:00100000:2.0:1789135891.672190:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306240 00000100:00100000:2.0:1789135891.672245:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789135891.672254:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723306240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.672315:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723306240:12345-0@lo:400:kworker.0 Request processed in 61us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.672322:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789135891.672364:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306624 00000100:00100000:2.0:1789135891.672368:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306624 00000100:00100000:2.0:1789135891.672404:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135891.672410:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723306624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.672444:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723306624:12345-0@lo:400:kworker.0 Request processed in 35us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.672450:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789135891.672464:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135891.672496:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9a40 x1876044723306624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135891.672509:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723306624:0@lo:400:kworker.0 00000100:00100000:3.0:1789135891.672861:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723306240:0@lo:400:kworker.0 00000100:00100000:3.0:1789135891.672914:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135891.672956:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306368 00000100:00100000:3.0:1789135891.672962:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306368 00000100:00100000:3.0:1789135891.673537:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306752 00000100:00100000:3.0:1789135891.673543:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306752 00000100:00100000:3.0:1789135891.673597:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789135891.673606:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723306368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.674068:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135891.674091:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723306752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.674187:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723306752:12345-0@lo:400:kworker.0 Request processed in 108us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.674207:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135891.674243:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135891.674310:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306496 00000100:00100000:1.0:1789135891.674317:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306496 00000100:00100000:2.0:1789135891.674346:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723306752:0@lo:400:kworker.0 00000100:00100000:1.0:1789135891.674369:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789135891.674380:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723306496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135891.674427:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723306368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135891.674508:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723306368:12345-0@lo:400:kworker.0 Request processed in 900us (5725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.674529:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789135891.674576:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135891.674760:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723306496:12345-0@lo:400:kworker.0 Request processed in 382us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135891.674767:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789135891.675566:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723306496:0@lo:400:kworker.0 00000100:00100000:3.0:1789135892.176211:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723306880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135892.176337:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.176644:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723306880 00000100:00100000:0.0:1789135892.176657:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723306880 00000100:00100000:0.0:1789135892.176776:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789135892.176789:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723306880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135892.176842:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135892.176907:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723306880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.176915:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789135892.176976:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073dcfc00 x1876044723306880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.177014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723306880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135892.305648:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135893.334768:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135894.351268:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135895.373634:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135896.399368:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135896.430446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135896.430630:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008832 00000100:00100000:0.0:1789135896.430642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008832 00000100:00100000:0.0:1789135896.430737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 232 00000100:00100000:0.0:1789135896.430749:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696008832:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135896.430828:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696008832:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 82us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135896.430835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 232 00000100:00100000:2.0:1789135896.443405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135896.443467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135896.443678:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696008960 00000100:00100000:1.0:1789135896.443688:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696008960 00000100:00100000:1.0:1789135896.443761:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009088 00000100:00100000:1.0:1789135896.443765:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009088 00000100:00100000:1.0:1789135896.443789:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:1.0:1789135896.443798:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696008960:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135896.443889:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696008960:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 91us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.443897:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:1.0:1789135896.443919:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00100000:1.0:1789135896.443925:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696009088:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135896.443951:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696009088:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.443956:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00080000:1.0:1789135896.443977:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135896.444288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135896.444433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135896.455464:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009216 00000100:00100000:1.0:1789135896.455482:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009216 00000100:00100000:1.0:1789135896.455575:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009344 00000100:00100000:1.0:1789135896.455579:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009344 00000100:00100000:1.0:1789135896.455609:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:1.0:1789135896.455618:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07257d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2362:x1876044696009216:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:1.0:1789135896.455666:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf96096 00000100:00080000:1.0:1789135896.455678:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135896.455736:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789135896.456152:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07257d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+2:2362:x1876044696009216:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 532us (11861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.456161:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:1.0:1789135896.456390:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:1.0:1789135896.456400:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2362:x1876044696009344:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:1.0:1789135896.456413:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf9609d 00000100:00080000:1.0:1789135896.456420:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135896.456457:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789135896.456674:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+2:2362:x1876044696009344:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 275us (12241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.456681:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00010000:00010000:1.0:1789135896.456752:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135896.456764:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789135896.456775:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135896.456781:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135896.780994:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723307136:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781075:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781119:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723307648:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781177:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789135896.781183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723307008:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781214:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781237:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723307520:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781260:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781286:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307392:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781335:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135896.781349:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723307264:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135896.781414:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307648 00000100:00100000:2.0:1789135896.781425:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307648 00000100:00100000:2.0:1789135896.781494:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307392 00000100:00100000:2.0:1789135896.781497:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307392 00000100:00100000:2.0:1789135896.781520:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135896.781528:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781578:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723307648:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781586:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135896.781602:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135896.781608:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781640:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307392:12345-0@lo:400:kworker.0 Request processed in 32us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781659:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135896.781678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307008 00000100:00100000:2.0:1789135896.781682:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307008 00000100:00100000:2.0:1789135896.781736:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789135896.781743:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723307008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781772:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723307008:12345-0@lo:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781779:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789135896.781805:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307136 00000100:00100000:2.0:1789135896.781809:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307136 00000100:00100000:2.0:1789135896.781831:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307520 00000100:00100000:2.0:1789135896.781834:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307520 00000100:00100000:2.0:1789135896.781847:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307264 00000100:00100000:2.0:1789135896.781857:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307264 00000100:00100000:2.0:1789135896.781873:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789135896.781880:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723307136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781912:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723307136:12345-0@lo:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781918:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789135896.781927:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789135896.781932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723307520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781952:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723307520:12345-0@lo:400:kworker.0 Request processed in 21us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781957:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789135896.781965:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789135896.781969:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723307264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.781987:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723307264:12345-0@lo:400:kworker.0 Request processed in 18us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.781992:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789135896.782013:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135896.782018:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135896.782020:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135896.782054:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723307264:0@lo:400:kworker.0 00010000:00080000:2.0:1789135896.782067:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce83c0 x1876044723307392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135896.782077:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307392:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.782107:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723307008:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.782118:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723307520:0@lo:400:kworker.0 00000100:00100000:2.0:1789135896.782136:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723307136:0@lo:400:kworker.0 00010000:00080000:2.0:1789135896.782147:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0738bf480 x1876044723307648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135896.782158:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723307648:0@lo:400:kworker.0 00000100:00100000:1.0:1789135896.784094:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135896.784115:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135896.784204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135896.784261:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307776 00000100:00100000:1.0:1789135896.784271:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307776 00000100:00100000:1.0:1789135896.784325:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789135896.784335:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135896.784380:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135896.784435:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.784443:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789135896.784488:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec4f00 x1876044723307776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135896.784506:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135897.293202:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135897.293380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.304015:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723307904 00000100:00100000:3.0:1789135897.304036:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723307904 00000100:00100000:3.0:1789135897.304139:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135897.304156:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135897.304219:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135897.304337:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723307904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (10959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.304345:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789135897.304523:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073dce580 x1876044723307904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135897.304555:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723307904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135897.422929:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789135897.875295:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000020:00000080:3.0:1789135897.875308:0:7663:0:(genops.c:885:class_export_put()) final put ffff8b9f4724a800/91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000020:00000080:2.0:1789135897.875393:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724a800/91a64b89-0f15-49f3-b3dc-09d2b2283f2e for lustre-OST0001 00000020:00000080:2.0:1789135897.876038:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f4724b000 for lustre-OST0001 00010000:00010000:1.0:1789135898.446077:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135899.470412:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135900.453997:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000020:00000080:1.0:1789135900.454016:0:6724:0:(genops.c:885:class_export_put()) final put ffff8b9f46d41000/91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000020:00000080:1.0:1789135900.454075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f46d41000/91a64b89-0f15-49f3-b3dc-09d2b2283f2e for lustre-OST0000 00000020:00000080:1.0:1789135900.454137:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f4724d000 for lustre-OST0000 00010000:00010000:1.0:1789135900.495945:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135901.520893:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135901.550465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135901.550516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135901.550549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135901.550654:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009600 00000100:00100000:0.0:1789135901.550668:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009600 00000100:00100000:0.0:1789135901.550767:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009728 00000100:00100000:0.0:1789135901.550771:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009728 00000100:00100000:0.0:1789135901.550793:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:0.0:1789135901.550802:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696009600:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135901.550887:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696009600:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 86us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135901.550895:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:0.0:1789135901.550912:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00100000:0.0:1789135901.550919:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696009728:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135901.550942:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696009728:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135901.550948:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00080000:1.0:1789135901.551060:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135901.551245:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009472 00000100:00100000:3.0:1789135901.551250:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009472 00000100:00100000:3.0:1789135901.551351:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 234 00000100:00100000:3.0:1789135901.551359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696009472:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135901.554010:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696009472:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 2634us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135901.554025:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 234 00000100:00100000:3.0:1789135901.901323:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723308032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135901.901480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135901.901733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723308416:0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.901861:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723308544:0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.901878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135901.901928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135901.901961:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789135901.901975:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723308288:0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.901977:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789135901.901991:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723308160:0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135901.902057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135901.902077:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723308800:0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.902107:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723308672:0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135901.902158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135901.902228:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308416 00000100:00100000:0.0:1789135901.902238:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308416 00000100:00100000:3.0:1789135901.902250:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308544 00000100:00100000:3.0:1789135901.902259:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308544 00000100:00100000:0.0:1789135901.902316:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308288 00000100:00100000:0.0:1789135901.902325:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308288 00000100:00100000:3.0:1789135901.902328:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308800 00000100:00100000:3.0:1789135901.902334:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308800 00000100:00100000:0.0:1789135901.902359:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308672 00000100:00100000:0.0:1789135901.902366:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308672 00000100:00100000:3.0:1789135901.902384:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135901.902399:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723308544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902411:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789135901.902423:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723308416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.902494:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723308544:12345-0@lo:400:kworker.0 Request processed in 97us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135901.902506:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789135901.902507:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723308416:12345-0@lo:400:kworker.0 Request processed in 83us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135901.902524:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135901.902562:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135901.902580:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723308800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902581:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789135901.902604:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723308288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.902643:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723308800:12345-0@lo:400:kworker.0 Request processed in 70us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135901.902653:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789135901.902683:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723308288:12345-0@lo:400:kworker.0 Request processed in 82us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135901.902691:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789135901.902745:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308160 00000100:00100000:3.0:1789135901.902752:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308160 00000100:00100000:0.0:1789135901.902759:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789135901.902775:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723308672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.902797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789135901.902811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723308160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902827:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723308672:12345-0@lo:400:kworker.0 Request processed in 54us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135901.902858:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789135901.902907:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723308160:12345-0@lo:400:kworker.0 Request processed in 99us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135901.902917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789135901.902934:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723308288:0@lo:400:kworker.0 00010000:00080000:0.0:1789135901.902957:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073dccb40 x1876044723308800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135901.902968:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723308800:0@lo:400:kworker.0 00000100:00100000:0.0:1789135901.902990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723308416:0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.903009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723308160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135901.903035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723308672:0@lo:400:kworker.0 00010000:00080000:3.0:1789135901.903056:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073dcf0c0 x1876044723308544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135901.903069:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723308544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135901.903457:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308032 00000100:00100000:1.0:1789135901.903465:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308032 00000100:00100000:1.0:1789135901.903510:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789135901.903518:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723308032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135901.903563:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135901.903623:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723308032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135901.903630:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789135901.903656:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135901.903662:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135901.903676:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135901.903802:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec4f00 x1876044723308032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135901.903823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723308032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135902.433050:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723308928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135902.433127:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.433338:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723308928 00000100:00100000:1.0:1789135902.433346:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723308928 00000100:00100000:1.0:1789135902.433400:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789135902.433411:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723308928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135902.433447:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135902.433494:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723308928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.433502:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789135902.433549:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072ec7840 x1876044723308928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135902.433576:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072ec7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723308928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135902.540946:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135902.734273:0:11047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789135903.567190:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135904.589842:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135905.619580:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135906.640038:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135906.679252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135906.679299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135906.679330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135906.679364:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010112 00000100:00100000:1.0:1789135906.679373:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010112 00000100:00100000:0.0:1789135906.679774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009856 00000100:00100000:0.0:1789135906.679780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009856 00000100:00100000:0.0:1789135906.679837:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 236 00000100:00100000:0.0:1789135906.679848:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696009856:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135906.679924:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696009856:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 77us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135906.679932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 236 00000100:00080000:0.0:1789135906.681504:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135906.685676:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696009984 00000100:00100000:1.0:1789135906.685720:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696009984 00000100:00080000:3.0:1789135906.685850:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135906.685977:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:0.0:1789135906.685995:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696010112:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135906.686087:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696010112:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 96us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135906.686095:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:0.0:1789135906.686117:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 104 00000100:00100000:0.0:1789135906.686123:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696009984:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135906.686142:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696009984:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 19us (6812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135906.686159:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 104 00000020:00000080:0.0:1789135906.713012:0:11196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc136f9ee0 20000000:00000080:0.0:1789135906.713033:0:11196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba074304800 uarg=0000000000000000 20000000:01000000:0.0:1789135906.713072:0:11196:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135906.713078:0:11196:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135906.713083:0:11196:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789135906.714362:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789135906.714534:0:11196:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789135906.721373:0:11196:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135906.721552:0:11196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721594:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721604:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96050 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721612:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9605e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721619:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9606c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721627:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.721635:0:11196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.722506:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.722545:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.722565:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309056:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135906.722735:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.722744:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 18 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.722754:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dccf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309184:0@lo:104: 00000100:00100000:0.0:1789135906.722819:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135906.722860:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.722869:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 18 pid: 5842 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.722877:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309312:0@lo:104: 00000100:00100000:0.0:1789135906.722900:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135906.722925:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.722933:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 18 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.722940:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309440:0@lo:104: 00000100:00100000:0.0:1789135906.722962:0:11196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135906.722997:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135906.723007:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 12 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.723017:0:11196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309568:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135906.723041:0:11196:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044c55240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135906.723126:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309184 00000100:00100000:1.0:1789135906.723135:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309184 00000100:00100000:1.0:1789135906.723453:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309312 00000100:00100000:1.0:1789135906.723468:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309312 00000100:00100000:1.0:1789135906.723486:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309440 00000100:00100000:1.0:1789135906.723489:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309440 00000100:00100000:1.0:1789135906.723502:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135906.723510:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:11196:x1876044723309184:12345-0@lo:104: 00010000:00010000:1.0:1789135906.723524:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723593:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135906.723599:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+5:11196:x1876044723309184:12345-0@lo:104: Request processed in 90us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.723606:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135906.723636:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135906.723641:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:11196:x1876044723309312:12345-0@lo:104: 00010000:00010000:1.0:1789135906.723649:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723682:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135906.723687:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:11196:x1876044723309312:12345-0@lo:104: Request processed in 46us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.723693:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135906.723722:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dccf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309184:0@lo:104: 00000100:00100000:1.0:1789135906.723723:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135906.723730:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11196:x1876044723309440:12345-0@lo:104: 00000100:00100000:3.0:1789135906.723733:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309312:0@lo:104: 00010000:00010000:1.0:1789135906.723737:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723777:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789135906.723782:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11196:x1876044723309440:12345-0@lo:104: Request processed in 54us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.723789:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789135906.723809:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789135906.723816:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723823:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8c00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135906.723828:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723836:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135906.723855:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135906.723862:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135906.723901:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723909:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135906.723934:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723942:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf9606c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96073 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135906.723951:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309440:0@lo:104: 00010000:00010000:1.0:1789135906.723953:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135906.723956:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723963:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135906.723965:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.723972:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135906.723978:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135906.723984:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135906.724007:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724013:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135906.724020:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724027:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf9605e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96065 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724036:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135906.724038:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724044:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9800 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135906.724047:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724053:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135906.724059:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135906.724063:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135906.724077:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724083:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135906.724106:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724121:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec9800/0x38eb79866bf96050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf96057 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724133:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135906.724135:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135906.724136:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135906.724143:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135906.724163:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723309696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135906.724198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135906.724231:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135906.724237:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723309824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135906.724259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135906.724284:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135906.724291:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723309952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135906.724313:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135906.724337:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309696 00000100:00100000:1.0:1789135906.724341:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309696 00010000:00010000:1.0:1789135906.724358:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 19 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135906.724378:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309824 00000100:00100000:1.0:1789135906.724380:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309824 00010000:00010000:1.0:1789135906.724389:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 20 pid: 5842 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135906.724398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723309952 00000100:00100000:1.0:1789135906.724400:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723309952 00010000:00010000:1.0:1789135906.724407:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 21 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135906.724425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789135906.724431:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba049182850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+21:3313:x1876044723309696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135906.724440:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135906.724446:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 21 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724454:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 21 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724482:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030400/0x38eb79866bf96073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf9606c expref: 21 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724493:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135906.724533:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba049182850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+20:3313:x1876044723309696:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.724540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789135906.724578:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789135906.724583:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723309824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135906.724590:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135906.724594:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 19 pid: 5842 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724601:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 19 pid: 5842 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724611:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf96065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf9605e expref: 19 pid: 5842 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724630:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135906.724654:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3313:x1876044723309824:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.724659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789135906.724672:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135906.724678:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3312:x1876044723309952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135906.724685:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135906.724689:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 17 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724722:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 17 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724735:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031200/0x38eb79866bf96057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf96050 expref: 17 pid: 5844 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135906.724744:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135906.724770:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3312:x1876044723309952:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135906.724776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135906.724810:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723309952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135906.724904:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723309824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135906.724911:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723309696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135906.733240:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309056:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135906.733260:0:11196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876044723309568:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135906.733303:0:11196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135906.734844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135906.734883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135906.735031:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010368 00000100:00100000:2.0:1789135906.735041:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010368 00010000:00010000:2.0:1789135906.735085:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 13 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135906.735134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010240 00000100:00100000:2.0:1789135906.735138:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010240 00010000:00010000:2.0:1789135906.735150:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 14 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135906.735183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789135906.735193:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+14:2364:x1876044696010368:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135906.735221:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135906.735227:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 14 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735239:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 14 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735263:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf96049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe7f expref: 14 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735303:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135906.735364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696010368:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 173us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135906.735372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789135906.735392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:2.0:1789135906.735399:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696010240:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135906.735407:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135906.735412:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735422:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735434:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf96088 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb7 expref: 12 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735446:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735455:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735483:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735490:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735506:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735513:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735520:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135906.735524:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735533:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735555:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135906.735568:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135906.735601:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:2364:x1876044696010240:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 202us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135906.735608:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00010000:00010000:3.0:1789135906.735905:0:11196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135906.735915:0:11196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135906.735928:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030800/0x38eb79866bf960a4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135907.021021:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723310208:0@lo:400:kworker.0 00000100:00100000:2.0:1789135907.021109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135907.021174:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135907.021180:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723310336:0@lo:400:kworker.0 00000100:00100000:2.0:1789135907.021207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135907.021242:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310336 00000100:00100000:2.0:1789135907.021249:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310336 00000100:00100000:2.0:1789135907.021307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135907.021332:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723310336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021469:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723310080:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.021521:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723310592:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.021565:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135907.021583:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723310464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.021633:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310592 00000100:00100000:3.0:1789135907.021637:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310592 00000100:00100000:3.0:1789135907.021675:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789135907.021681:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723310592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021750:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723310592:12345-0@lo:400:kworker.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.021756:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789135907.021776:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310208 00000100:00100000:3.0:1789135907.021780:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310208 00000100:00100000:3.0:1789135907.021802:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310080 00000100:00100000:3.0:1789135907.021805:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310080 00000100:00100000:3.0:1789135907.021816:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310464 00000100:00100000:3.0:1789135907.021817:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310464 00000100:00100000:3.0:1789135907.021833:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789135907.021839:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723310208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021876:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723310208:12345-0@lo:400:kworker.0 Request processed in 37us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.021891:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789135907.021903:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789135907.021908:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723310080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723310080:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.021938:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789135907.021946:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789135907.021951:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723310464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.021972:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723310464:12345-0@lo:400:kworker.0 Request processed in 21us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.021976:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789135907.022009:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723310464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.022017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723310080:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.022026:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0738bf0c0 x1876044723310592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.022035:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723310592:0@lo:400:kworker.0 00000100:00100000:2.0:1789135907.022582:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723310336:12345-0@lo:400:kworker.0 Request processed in 1239us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.022590:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789135907.022613:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135907.022618:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135907.022620:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135907.022652:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0738bc780 x1876044723310336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135907.022664:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723310336:0@lo:400:kworker.0 00000100:00100000:2.0:1789135907.022675:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723310208:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.023089:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135907.023104:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723310720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135907.023140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135907.023221:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310720 00000100:00100000:0.0:1789135907.023227:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310720 00000100:00100000:0.0:1789135907.023269:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135907.023278:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723310720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135907.023308:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135907.023355:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723310720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.023361:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789135907.023449:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074300000 x1876044723310720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135907.023475:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723310720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135907.532991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135907.533018:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723310848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135907.533093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135907.533509:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310848 00000100:00100000:0.0:1789135907.533517:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310848 00000100:00100000:0.0:1789135907.533586:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135907.533596:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723310848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135907.533637:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135907.533728:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723310848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.533737:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789135907.534894:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074300000 x1876044723310848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135907.534918:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723310848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135907.660989:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135907.952867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135907.952971:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010496 00000100:00100000:2.0:1789135907.952982:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010496 00000100:00100000:2.0:1789135907.953042:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 237 00000100:00100000:2.0:1789135907.953052:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:5611:x1876044696010496:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135907.953069:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135907.953088:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fee1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135907.953130:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135907.953142:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135907.953152:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0ee00, rc 0) 00000100:00100000:2.0:1789135907.953214:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010496:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.953221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 237 00000100:00100000:2.0:1789135907.956777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135907.956829:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010624 00000100:00100000:3.0:1789135907.956840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010624 00000100:00100000:3.0:1789135907.956882:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 238 00000100:00100000:3.0:1789135907.956890:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010624:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135907.957315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010624:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 424us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.957323:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 238 00000100:00100000:0.0:1789135907.960835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135907.961015:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010752 00000100:00100000:2.0:1789135907.961027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010752 00000100:00100000:2.0:1789135907.961087:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 239 00000100:00100000:2.0:1789135907.961098:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010752:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135907.961346:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010752:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 249us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.961355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 239 00000100:00100000:1.0:1789135907.965921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135907.966588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696010880 00000100:00100000:0.0:1789135907.966618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696010880 00000100:00100000:0.0:1789135907.966690:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 240 00000100:00100000:0.0:1789135907.966751:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696010880:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135907.966773:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135907.966802:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fee8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135907.966845:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135907.966856:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135907.966866:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030800, rc 0) 00000100:00100000:0.0:1789135907.966940:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696010880:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 240us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.966947:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 240 00000100:00100000:0.0:1789135907.969827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135907.969938:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011008 00000100:00100000:2.0:1789135907.969948:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011008 00000100:00100000:2.0:1789135907.970010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 241 00000100:00100000:2.0:1789135907.970019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696011008:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135907.970688:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696011008:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 666us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.970741:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 241 00000100:00100000:1.0:1789135907.973658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135907.976440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011136 00000100:00100000:3.0:1789135907.976460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011136 00000100:00100000:2.0:1789135907.976657:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 242 00000100:00100000:2.0:1789135907.976668:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696011136:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135907.977163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696011136:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 495us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.977172:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 242 00010000:00010000:1.0:1789135908.691291:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135908.748789:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135908.748800:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b9f45966800 from 7 10000000:01000000:1.0:1789135908.748807:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135908.749921:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135908.749938:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135908.749950:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135908.749980:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723310976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135908.750077:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.750233:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135908.753621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723310976 00000100:00100000:3.0:1789135908.753636:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723310976 00000100:00100000:3.0:1789135908.753747:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789135908.753759:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723310976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135908.753778:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135908.753801:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf960b9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135908.753914:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135908.753931:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135908.753944:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789135908.754131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723310976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.754139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789135908.760538:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723310976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135908.760580:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135908.760595:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135908.760684:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135908.760766:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.760974:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135908.763796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311104 00000100:00100000:3.0:1789135908.763817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311104 00000100:00100000:3.0:1789135908.763903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789135908.763913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723311104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135908.764237:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723311104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.764253:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789135908.764631:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135908.764715:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135908.764769:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.764810:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135908.764884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311232 00000100:00100000:3.0:1789135908.764889:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311232 00000100:00100000:3.0:1789135908.764982:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789135908.764991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723311232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135908.765168:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723311232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.765177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789135908.765249:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074303c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789135908.782911:0:11252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789135908.789530:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789135908.789588:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135908.789601:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.789616:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135908.789629:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135908.789631:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba0504e6000 from 7 10000000:01000000:0.0:1789135908.789634:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135908.789685:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.789693:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.789720:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135908.789756:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.789839:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135908.789888:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044e12300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135908.790182:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311360 00000100:00100000:2.0:1789135908.790193:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311360 00000100:00100000:2.0:1789135908.790263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789135908.790273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723311360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135908.790289:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135908.790304:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf960c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.790336:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.790346:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.790356:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0fc00, rc 0) 00000100:00100000:2.0:1789135908.790414:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135908.790433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789135908.791044:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135908.791063:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.791074:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135908.791154:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.791197:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135908.791233:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044e12300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135908.791253:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311488 00000100:00100000:0.0:1789135908.791258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311488 00000100:00100000:0.0:1789135908.791291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789135908.791299:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.792168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 864us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135908.792190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789135908.792515:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135908.792590:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135908.792649:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135908.792690:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0448e6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135908.793515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311616 00000100:00100000:0.0:1789135908.793527:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311616 00000100:00100000:0.0:1789135908.793664:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789135908.793675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.794160:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 485us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135908.794169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789135908.799873:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789135908.804360:0:11253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789135908.807522:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789135908.807884:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135908.807899:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135908.807912:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135908.811525:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135908.811618:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 7 10000000:01000000:0.0:1789135908.811626:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135908.811845:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.811860:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.811874:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135908.811908:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.812019:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135908.812137:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135908.814520:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311744 00000100:00100000:3.0:1789135908.814659:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311744 00000100:00100000:2.0:1789135908.822269:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789135908.822295:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723311744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135908.822316:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135908.822336:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf960d5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.822369:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.822381:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.822391:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e800, rc 0) 00000100:00100000:2.0:1789135908.822494:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723311744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (10474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135908.822502:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789135908.822593:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135908.822613:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.822637:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135908.822741:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.822776:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135908.827857:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135908.829913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723311872 00000100:00100000:3.0:1789135908.829930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723311872 00000100:00100000:3.0:1789135908.830014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789135908.830026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723311872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135908.833480:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723311872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3443us (10689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.833499:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789135908.834731:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723311872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.834817:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723312000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.834896:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135908.834944:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135908.834964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312000 00000100:00100000:0.0:1789135908.834971:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312000 00000100:00100000:0.0:1789135908.835034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789135908.835045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723312000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135908.835277:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723312000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135908.835285:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789135908.835338:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dced00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723312000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789135908.838434:0:11254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789135908.843641:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789135908.843685:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135908.844805:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135908.844827:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.711367:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135910.735680:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135911.400274:0:11394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135911.758900:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135911.801798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135911.801833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135911.801867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135911.801968:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011264 00000100:00100000:0.0:1789135911.801979:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011264 00000100:00100000:0.0:1789135911.802048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 252 00000100:00100000:0.0:1789135911.802059:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696011264:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135911.802145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696011264:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 88us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135911.802153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 252 00000100:00100000:3.0:1789135911.804278:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011520 00000100:00100000:3.0:1789135911.804295:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011520 00000100:00100000:3.0:1789135911.804402:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011392 00000100:00100000:3.0:1789135911.804406:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011392 00000100:00100000:3.0:1789135911.804436:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 108 00000100:00100000:3.0:1789135911.804447:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696011520:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135911.804597:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 109 00000100:00100000:2.0:1789135911.804609:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696011392:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135911.804671:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696011392:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 65us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135911.804678:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 109 00000100:00080000:0.0:1789135911.804773:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135911.805888:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696011520:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 1437us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135911.805900:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 108 00000100:00100000:3.0:1789135912.141050:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135912.141079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723312128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135912.141174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135912.141292:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312128 00000100:00100000:1.0:1789135912.141301:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312128 00000100:00100000:1.0:1789135912.141381:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135912.141391:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723312128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135912.141430:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135912.141482:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723312128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135912.141489:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789135912.141544:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074302580 x1876044723312128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135912.141562:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074302580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723312128:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789135912.141821:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135912.142285:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723312512:0@lo:400:kworker.0 00000100:00100000:3.0:1789135912.142331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135912.142377:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135912.142383:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723312384:0@lo:400:kworker.0 00000100:00100000:3.0:1789135912.142407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.142866:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723312640:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.142905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.142927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135912.142933:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0412aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.142963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.143048:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723312768:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.143107:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312512 00000100:00100000:0.0:1789135912.143112:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312512 00000100:00100000:2.0:1789135912.143134:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312256 00000100:00100000:2.0:1789135912.143139:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312256 00000100:00100000:3.0:1789135912.143153:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312640 00000100:00100000:3.0:1789135912.143159:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312640 00000100:00100000:0.0:1789135912.143163:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312384 00000100:00100000:2.0:1789135912.143166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789135912.143167:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312384 00000100:00100000:2.0:1789135912.143189:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723312256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143189:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312768 00000100:00100000:0.0:1789135912.143192:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312768 00000100:00100000:3.0:1789135912.143204:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789135912.143213:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789135912.143218:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723312640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143225:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723312512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.143240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723312256:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.143247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789135912.143278:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723312640:12345-0@lo:400:kworker.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135912.143283:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723312512:12345-0@lo:400:kworker.0 Request processed in 60us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135912.143292:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135912.143293:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135912.143303:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143304:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789135912.143323:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789135912.143329:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723312768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.143332:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723312384:12345-0@lo:400:kworker.0 Request processed in 31us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.143338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789135912.143344:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135912.143367:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135912.143369:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723312768:12345-0@lo:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135912.143378:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135912.143412:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723312384:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143412:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0412aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723312256:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.143422:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723312768:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.143423:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723312512:0@lo:400:kworker.0 00010000:00080000:0.0:1789135912.143433:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0739dde00 x1876044723312640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135912.143442:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723312640:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.653066:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135912.653143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135912.653281:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723312896 00000100:00100000:1.0:1789135912.653290:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723312896 00000100:00100000:1.0:1789135912.653361:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135912.653370:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723312896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135912.653415:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135912.653463:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723312896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135912.653471:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789135912.654071:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074300000 x1876044723312896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135912.654091:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723312896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135912.781029:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135913.804863:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135914.834537:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135915.852923:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135916.877848:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135916.920515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135916.920747:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011776 00000100:00100000:3.0:1789135916.920757:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011776 00000100:00100000:3.0:1789135916.920844:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:3.0:1789135916.920854:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696011776:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135916.920944:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696011776:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135916.920951:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00080000:2.0:1789135916.921505:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135916.926223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135916.926288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135916.926404:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011904 00000100:00100000:2.0:1789135916.926414:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011904 00000100:00100000:2.0:1789135916.926491:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00100000:2.0:1789135916.926501:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696011904:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135916.926590:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696011904:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135916.926599:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00080000:3.0:1789135916.926944:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135916.927118:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696011648 00000100:00100000:1.0:1789135916.927124:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696011648 00000100:00100000:1.0:1789135916.927167:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 254 00000100:00100000:1.0:1789135916.927177:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696011648:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135916.927225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696011648:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 49us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135916.927231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 254 00000100:00100000:0.0:1789135917.261133:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135917.261168:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135917.261267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135917.261400:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313024 00000100:00100000:1.0:1789135917.261410:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313024 00000100:00100000:1.0:1789135917.261521:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789135917.261532:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723313024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135917.261575:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135917.261632:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723313024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.261640:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789135917.261682:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135917.263850:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723313152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.263935:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.263977:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723313664:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.264075:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135917.264081:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723313280:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.264243:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313152 00000100:00100000:2.0:1789135917.264252:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313152 00000100:00100000:2.0:1789135917.264311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789135917.264320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723313152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264376:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723313152:12345-0@lo:400:kworker.0 Request processed in 56us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.264383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789135917.264434:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313664 00000100:00100000:2.0:1789135917.264439:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313664 00000100:00100000:2.0:1789135917.264478:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313280 00000100:00100000:2.0:1789135917.264482:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313280 00000100:00100000:2.0:1789135917.264525:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789135917.264532:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723313664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264568:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723313664:12345-0@lo:400:kworker.0 Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.264574:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789135917.264830:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789135917.264838:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723313280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264873:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723313280:12345-0@lo:400:kworker.0 Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.264889:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789135917.264926:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723313536:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.264955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.264975:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135917.264981:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723313408:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265000:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.265021:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313536 00000100:00100000:2.0:1789135917.265025:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313536 00000100:00100000:2.0:1789135917.265053:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135917.265059:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723313536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265089:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723313536:12345-0@lo:400:kworker.0 Request processed in 30us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.265095:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789135917.265111:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135917.265115:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789135917.265144:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0738be580 x1876044723313536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135917.265162:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723313536:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313408 00000100:00100000:2.0:1789135917.265183:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313408 00000100:00100000:2.0:1789135917.265202:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789135917.265207:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723313408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265234:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723313408:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.265240:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1789135917.265273:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135917.265289:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723313408:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265308:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723313280:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265316:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723313152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.265324:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723313664:0@lo:400:kworker.0 00010000:00080000:1.0:1789135917.268306:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074300000 x1876044723313024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135917.268354:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723313024:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789135917.621150:0:11638:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe508ba700 20000000:00000080:1.0:1789135917.621168:0:11638:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba05935a000 uarg=0000000000000000 20000000:01000000:1.0:1789135917.621209:0:11638:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789135917.621216:0:11638:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789135917.621221:0:11638:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789135917.626878:0:11639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789135917.627072:0:11638:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789135917.639343:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789135917.640562:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:2.0:1789135917.641276:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:2.0:1789135917.641306:0:11638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789135917.641333:0:11638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641355:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641363:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641383:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641390:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641396:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641845:0:11638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641912:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.641932:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 18 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.641949:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723313792:0@lo:104: 00000100:00100000:2.0:1789135917.642024:0:11638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135917.642131:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.642139:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.642148:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723313920:0@lo:104: 00000100:00100000:2.0:1789135917.642181:0:11638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135917.642355:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.642364:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 18 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.642382:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314048:0@lo:104: 00000100:00100000:2.0:1789135917.642418:0:11638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135917.644606:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313792 00000100:00100000:1.0:1789135917.644626:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313792 00000100:00100000:3.0:1789135917.646315:0:7650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723313920 00000100:00100000:3.0:1789135917.646328:0:7650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723313920 00000100:00100000:3.0:1789135917.646397:0:7650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135917.646581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135917.646604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:11638:x1876044723313920:12345-0@lo:104: 00010000:00010000:0.0:1789135917.646623:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646746:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135917.646752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:11638:x1876044723313920:12345-0@lo:104: Request processed in 164us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.646779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789135917.646810:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135917.646816:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646825:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789135917.646830:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646840:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135917.646847:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135917.646852:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135917.646889:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646896:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135917.646917:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646925:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030400/0x38eb79866bf960c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.646939:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135917.646941:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135917.646943:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135917.646961:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135917.646988:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723314176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135917.647027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135917.647069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314176 00000100:00100000:0.0:1789135917.647073:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314176 00010000:00010000:0.0:1789135917.647095:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 19 pid: 5844 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135917.647120:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135917.647127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723314176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135917.647137:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135917.647142:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 19 pid: 5844 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135917.647340:0:7650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11638:x1876044723313792:12345-0@lo:104: 00010000:00010000:3.0:1789135917.647352:0:7650:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647550:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135917.647557:0:7650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11638:x1876044723313792:12345-0@lo:104: Request processed in 1152us (5533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.647565:0:7650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789135917.647648:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135917.647655:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647662:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135917.647676:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647686:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135917.647693:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135917.647715:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135917.647743:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647750:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135917.647777:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647784:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030200/0x38eb79866bf960d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.647795:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135917.647797:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135917.647798:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135917.647805:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135917.647816:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723314304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135917.647862:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135917.647939:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 19 pid: 5844 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.647961:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135917.648003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723314176:12345-0@lo:103:ldlm_bl.0 Request processed in 876us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.648010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135917.648025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314304 00000100:00100000:0.0:1789135917.648029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314304 00010000:00010000:0.0:1789135917.648044:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135917.648063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135917.648068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723314304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135917.648075:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135917.648079:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.648093:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135917.648103:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135917.648129:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723314304:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.648136:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789135917.648294:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.648309:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 12 pid: 5844 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.648333:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314432:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135917.648590:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723314176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135917.651438:0:6722:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135917.651466:0:6722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314048 00000100:00100000:1.0:1789135917.651475:0:6722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314048 00000100:00100000:1.0:1789135917.651529:0:6722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135917.651539:0:6722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46e68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11638:x1876044723314048:12345-0@lo:104: 00010000:00010000:1.0:1789135917.651562:0:6722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651677:0:6722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135917.651683:0:6722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46e68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:11638:x1876044723314048:12345-0@lo:104: Request processed in 146us (9264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.651691:0:6722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789135917.651777:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135917.651784:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651793:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789135917.651799:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651808:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135917.651840:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135917.651846:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135917.651882:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651887:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135917.651904:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651910:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8400/0x38eb79866bf960b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960c0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.651929:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135917.651931:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135917.651933:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135917.651939:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135917.651956:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723314560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135917.652003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135917.652046:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314560 00000100:00100000:1.0:1789135917.652051:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314560 00010000:00010000:1.0:1789135917.652070:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 19 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.653999:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135917.654018:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.654033:0:11638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314688:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135917.654113:0:11638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d480 going to sleep for 11 seconds 00010000:00010000:2.0:1789135917.654148:0:11638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf960dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf960d5 expref: 19 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.654180:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723313792:0@lo:104: 00010000:00010000:2.0:1789135917.654194:0:11638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0fc00/0x38eb79866bf960ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf960c7 expref: 18 pid: 5844 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135917.654203:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723313920:0@lo:104: 00000100:00100000:2.0:1789135917.654213:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314048:0@lo:104: 00000100:00100000:1.0:1789135917.659719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135917.659744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba049181c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3313:x1876044723314560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135917.659771:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135917.659798:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 17 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.659818:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 17 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.659844:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a4a00/0x38eb79866bf960c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf960b9 expref: 17 pid: 5843 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.659861:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135917.659949:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba049181c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3313:x1876044723314560:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (7944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.659958:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789135917.660260:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723314560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135917.663379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723314304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135917.670330:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314432:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135917.670347:0:11638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876044723314688:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135917.670398:0:11638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135917.672751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135917.672854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012032 00000100:00100000:1.0:1789135917.672864:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012032 00010000:00010000:1.0:1789135917.672906:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135917.672949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:1.0:1789135917.672960:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696012032:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135917.672977:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135917.672983:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.672996:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.673014:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030800/0x38eb79866bf960b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee8 expref: 13 pid: 5844 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.673049:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135917.673109:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696012032:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 150us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.673117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:2.0:1789135917.684462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135917.684563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012160 00000100:00100000:1.0:1789135917.684588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012160 00010000:00010000:1.0:1789135917.684657:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135917.684742:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:1.0:1789135917.684752:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696012160:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135917.684771:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135917.684777:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684791:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684809:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fee1 expref: 12 pid: 5843 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684828:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684837:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684855:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684875:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684882:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684888:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684894:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0fe00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135917.684897:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684904:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684925:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135917.684935:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135917.685013:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:2364:x1876044696012160:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 262us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.685020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00010000:00010000:3.0:1789135917.685924:0:11638:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.685944:0:11638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135917.685951:0:11638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0fe00/0x38eb79866bf960e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135917.782244:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723314816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135917.782332:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135917.789555:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314816 00000100:00100000:0.0:1789135917.789571:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314816 00000100:00100000:0.0:1789135917.789635:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135917.789728:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723314816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135917.789777:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135917.792390:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723314816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2726us (10037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.792405:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789135917.804695:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074301680 x1876044723314816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135917.804856:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723314816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135917.914445:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135918.940213:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789135919.053249:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135919.053258:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b9f45966800 from 7 10000000:01000000:3.0:1789135919.053264:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135919.053322:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.053335:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.053357:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135919.053387:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723314944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135919.053486:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135919.053600:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.060255:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723314944 00000100:00100000:2.0:1789135919.060292:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723314944 00000100:00100000:2.0:1789135919.060480:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789135919.060490:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723314944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135919.060509:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135919.060532:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf960ea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.060566:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf960ea expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.060578:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960ea expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.060588:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0ee00, rc 0) 00000100:00100000:2.0:1789135919.064074:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723314944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3570us (10573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.064088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789135919.064253:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723314944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135919.064278:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135919.064290:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135919.064366:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135919.064418:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135919.081653:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135919.084453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315072 00000100:00100000:3.0:1789135919.084469:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315072 00000100:00100000:3.0:1789135919.084537:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789135919.084548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723315072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135919.085736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723315072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1147us (21276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.085748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789135919.086180:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.086538:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0743021c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.086609:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135919.086718:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.086836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315200 00000100:00100000:2.0:1789135919.086844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315200 00000100:00100000:2.0:1789135919.087084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789135919.087105:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723315200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.087333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723315200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.087341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789135919.087439:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0743021c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135919.088972:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11701:1876044723315328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135919.089068:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135919.090503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315328 00000100:00100000:1.0:1789135919.090516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315328 00000100:00100000:1.0:1789135919.090574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789135919.090596:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:11701:x1876044723315328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135919.091650:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:11701:x1876044723315328:12345-0@lo:502:llog_process_th.0 Request processed in 1049us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.091661:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789135919.092131:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135919.092164:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11701:1876044723315328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135919.092205:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135919.092216:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135919.092218:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135919.092237:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b9f45966800 00000020:00000080:3.0:1789135919.092240:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135919.092332:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11701:1876044723315456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135919.092398:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135919.092433:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.092745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315456 00000100:00100000:2.0:1789135919.092752:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315456 00000100:00100000:2.0:1789135919.092791:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789135919.092799:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:11701:x1876044723315456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.093028:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:11701:x1876044723315456:12345-0@lo:502:llog_process_th.0 Request processed in 228us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.093035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789135919.093439:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11701:1876044723315456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135919.093467:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135919.093475:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135919.093483:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789135919.093487:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789135919.095447:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789135919.095481:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135919.095492:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.095504:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135919.095515:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135919.095518:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba0504e6000 from 7 10000000:01000000:2.0:1789135919.095520:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135919.095563:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.095571:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.095583:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135919.095610:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.097041:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.097162:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135919.097289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315584 00000100:00100000:3.0:1789135919.097297:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315584 00000100:00100000:3.0:1789135919.097866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789135919.097881:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723315584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135919.097900:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135919.097919:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf960f8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.097961:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.097973:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.097982:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:3.0:1789135919.098050:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723315584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.105506:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789135919.106047:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135919.106074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.106093:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135919.106165:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.106233:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.106277:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135919.107773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315712 00000100:00100000:1.0:1789135919.107788:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315712 00000100:00100000:1.0:1789135919.107848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789135919.107858:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723315712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.108204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723315712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.108211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789135919.109177:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.109259:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.109322:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.109373:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.109391:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315840 00000100:00100000:2.0:1789135919.109397:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315840 00000100:00100000:2.0:1789135919.109432:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789135919.109440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723315840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.109607:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723315840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.109614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789135919.109652:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723315840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.109909:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11703:1876044723315968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.109957:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.109978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723315968 00000100:00100000:2.0:1789135919.109982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723315968 00000100:00100000:2.0:1789135919.110000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789135919.110006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:11703:x1876044723315968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.110130:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:11703:x1876044723315968:12345-0@lo:502:llog_process_th.0 Request processed in 124us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.110137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789135919.110161:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.110172:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11703:1876044723315968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135919.110190:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135919.110199:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135919.110201:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135919.110207:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba0504e6000 00000020:00000080:2.0:1789135919.110209:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135919.110285:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11703:1876044723316096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.110314:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.110332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316096 00000100:00100000:2.0:1789135919.110336:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316096 00000100:00100000:2.0:1789135919.110352:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789135919.110357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:11703:x1876044723316096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.110458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:11703:x1876044723316096:12345-0@lo:502:llog_process_th.0 Request processed in 100us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.110464:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789135919.110493:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.110504:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11703:1876044723316096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135919.110521:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135919.110525:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135919.110526:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789135919.110530:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789135919.110583:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789135919.110606:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135919.110616:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110625:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135919.110635:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135919.110637:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 7 10000000:01000000:2.0:1789135919.110639:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135919.110661:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110668:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110677:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135919.110689:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.110738:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.110750:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.110761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316224 00000100:00100000:2.0:1789135919.110764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316224 00000100:00100000:2.0:1789135919.110779:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789135919.110784:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723316224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135919.110792:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135919.110806:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96106 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110842:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96106 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110854:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96106 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110863:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f800, rc 0) 00000100:00100000:2.0:1789135919.110891:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723316224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.110897:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789135919.110923:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135919.110933:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135919.110942:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135919.110982:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.111005:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.111017:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.111027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316352 00000100:00100000:2.0:1789135919.111030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316352 00000100:00100000:2.0:1789135919.111045:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789135919.111051:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723316352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.111269:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723316352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.111285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789135919.111314:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.111337:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.111369:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135919.111381:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.111392:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316480 00000100:00100000:2.0:1789135919.111395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316480 00000100:00100000:2.0:1789135919.111412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789135919.111417:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723316480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.111527:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723316480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.111533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789135919.111565:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723316480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135919.117202:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11704:1876044723316608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135919.117312:0:11704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135919.117366:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.117501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316608 00000100:00100000:2.0:1789135919.117510:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316608 00000100:00100000:2.0:1789135919.117551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789135919.117561:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:11704:x1876044723316608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.117841:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:11704:x1876044723316608:12345-0@lo:502:llog_process_th.0 Request processed in 280us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.117850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789135919.119513:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11704:1876044723316608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135919.119555:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135919.119567:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135919.119570:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135919.119576:0:11704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba04857c800 00000020:00000080:3.0:1789135919.119587:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135919.119685:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11704:1876044723316736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135919.119782:0:11704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135919.119822:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135919.121092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316736 00000100:00100000:2.0:1789135919.121104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316736 00000100:00100000:2.0:1789135919.121170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789135919.121180:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:11704:x1876044723316736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135919.122091:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:11704:x1876044723316736:12345-0@lo:502:llog_process_th.0 Request processed in 909us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.122101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789135919.122206:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:11704:1876044723316736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135919.122253:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135919.122262:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135919.122265:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789135919.122270:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135919.122539:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135919.122559:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135919.122569:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135919.122580:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135919.534829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.535327:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012288 00000100:00100000:1.0:1789135919.535400:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012288 00000100:00100000:1.0:1789135919.535544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 271 00000100:00100000:1.0:1789135919.535554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:5611:x1876044696012288:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135919.535574:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135919.535593:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62feef expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135919.536167:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135919.536180:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135919.536191:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9800, rc 0) 00000100:00100000:1.0:1789135919.538960:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012288:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 3395us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.538973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 271 00000100:00100000:2.0:1789135919.550191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.550380:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012416 00000100:00100000:1.0:1789135919.550390:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012416 00000100:00100000:1.0:1789135919.550465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 272 00000100:00100000:1.0:1789135919.550474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012416:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.551062:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012416:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 587us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.551073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 272 00000100:00100000:2.0:1789135919.553182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.553352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012544 00000100:00100000:1.0:1789135919.553360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012544 00000100:00100000:1.0:1789135919.553428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 273 00000100:00100000:1.0:1789135919.553438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012544:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.554267:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012544:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 825us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.554277:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 273 00000100:00100000:0.0:1789135919.567590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.567851:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012672 00000100:00100000:1.0:1789135919.567886:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012672 00000100:00100000:1.0:1789135919.567953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 274 00000100:00100000:1.0:1789135919.567963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:9549:x1876044696012672:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135919.568229:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:9549:x1876044696012672:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 267us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.568237:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 274 00000100:00100000:2.0:1789135919.576530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.576819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012800 00000100:00100000:1.0:1789135919.576830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012800 00000100:00100000:1.0:1789135919.576901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 275 00000100:00100000:1.0:1789135919.576911:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:9549:x1876044696012800:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135919.577341:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:9549:x1876044696012800:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 422us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.577350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 275 00000100:00100000:2.0:1789135919.591415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135919.591597:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696012928 00000100:00100000:3.0:1789135919.591611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696012928 00000100:00100000:3.0:1789135919.591678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 276 00000100:00100000:3.0:1789135919.591688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696012928:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135919.591733:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135919.591753:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fef6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.591782:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.591793:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135919.591802:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4e00, rc 0) 00000100:00100000:3.0:1789135919.591872:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696012928:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 176us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.591880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 276 00000100:00100000:0.0:1789135919.600917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135919.601138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013056 00000100:00100000:2.0:1789135919.601148:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013056 00000100:00100000:2.0:1789135919.601229:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 277 00000100:00100000:2.0:1789135919.601241:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696013056:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135919.601738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696013056:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 460us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.601748:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 277 00000100:00100000:2.0:1789135919.612520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.612808:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013184 00000100:00100000:1.0:1789135919.612818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013184 00000100:00100000:1.0:1789135919.612887:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 278 00000100:00100000:1.0:1789135919.612897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696013184:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135919.614145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696013184:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 1240us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.614157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 278 00000100:00100000:0.0:1789135919.628172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135919.629818:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013312 00000100:00100000:3.0:1789135919.629849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013312 00000100:00100000:3.0:1789135919.629969:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 279 00000100:00100000:3.0:1789135919.629980:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:9552:x1876044696013312:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135919.630263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:9552:x1876044696013312:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 284us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.630272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 279 00000100:00100000:0.0:1789135919.641901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135919.642123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013440 00000100:00100000:1.0:1789135919.642134:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013440 00000100:00100000:1.0:1789135919.642210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 280 00000100:00100000:1.0:1789135919.642237:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:9552:x1876044696013440:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135919.642525:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:9552:x1876044696013440:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 294us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135919.642540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 280 00010000:00010000:2.0:1789135919.955850:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135920.972869:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135921.997220:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135922.030798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135922.030878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135922.030923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135922.030952:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013824 00000100:00100000:0.0:1789135922.030961:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013824 00000100:00100000:0.0:1789135922.031021:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013696 00000100:00100000:0.0:1789135922.031024:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013696 00000100:00100000:0.0:1789135922.031048:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:0.0:1789135922.031057:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696013824:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135922.031135:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696013824:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135922.031142:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:0.0:1789135922.031160:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:0.0:1789135922.031178:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696013696:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135922.031217:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696013696:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135922.031224:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00080000:0.0:1789135922.031243:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135922.031736:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013568 00000100:00100000:3.0:1789135922.031742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013568 00000100:00100000:3.0:1789135922.031783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 281 00000100:00100000:3.0:1789135922.031790:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696013568:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135922.031825:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696013568:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 35us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135922.031832:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 281 00000100:00100000:3.0:1789135922.384369:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723316864:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.384520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135922.384982:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723317248:0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.385036:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135922.385100:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317248 00000100:00100000:2.0:1789135922.385110:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317248 00000100:00100000:2.0:1789135922.385187:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135922.385201:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723317248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.385263:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723317248:12345-0@lo:400:kworker.0 Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135922.385271:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789135922.385697:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135922.385769:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073dce1c0 x1876044723317248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135922.385788:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723317248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.391502:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135922.391596:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135922.391682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316864 00000100:00100000:3.0:1789135922.391690:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316864 00000100:00100000:3.0:1789135922.391756:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135922.391766:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723316864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.391825:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723316864:12345-0@lo:400:kworker.0 Request processed in 59us (7305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135922.391832:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135922.391891:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723316992:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.391976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135922.392002:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135922.392021:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723317120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.392056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135922.392129:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317376 00000100:00100000:3.0:1789135922.392133:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317376 00000100:00100000:3.0:1789135922.392195:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789135922.392206:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723317376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135922.392239:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135922.392278:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723317376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135922.392296:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135922.392830:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723316992 00000100:00100000:2.0:1789135922.392838:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723316992 00000100:00080000:0.0:1789135922.393765:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135922.393816:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba073ce9680 x1876044723317376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135922.394195:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317120 00000100:00100000:3.0:1789135922.394203:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317120 00000100:00100000:3.0:1789135922.394266:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789135922.394277:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723317120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.394619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789135922.394627:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723316992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135922.394856:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135922.394974:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723316864:0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.395048:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723316992:12345-0@lo:400:kworker.0 Request processed in 421us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135922.395055:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789135922.395576:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723317120:12345-0@lo:400:kworker.0 Request processed in 1301us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135922.395583:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789135922.395612:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135922.395627:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723317504:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.395680:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789135922.395785:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135922.395826:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723317120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135922.395850:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723316992:0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.398197:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317504 00000100:00100000:2.0:1789135922.398209:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317504 00000100:00100000:2.0:1789135922.398290:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789135922.398302:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723317504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135922.398420:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723317504:12345-0@lo:400:kworker.0 Request processed in 120us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135922.398428:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789135922.398444:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723317504:0@lo:400:kworker.0 00000100:00080000:0.0:1789135922.399192:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135922.892954:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135922.892986:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723317632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135922.893057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135922.893680:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317632 00000100:00100000:0.0:1789135922.893690:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317632 00000100:00100000:0.0:1789135922.893815:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135922.893826:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723317632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135922.893864:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135922.893930:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723317632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135922.893938:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789135922.894096:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba074301680 x1876044723317632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135922.894116:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723317632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135923.020822:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135924.051046:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135924.686673:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:12:02 (1789135922) === 00010000:00010000:1.0:1789135925.072725:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135926.093459:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135926.561051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.561443:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014080 00000100:00100000:0.0:1789135926.561452:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014080 00000100:00100000:0.0:1789135926.561506:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:0.0:1789135926.561517:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:9919:x1876044696014080:12345-192.168.204.41@tcp:700:mkdir.0 00000100:00100000:0.0:1789135926.561597:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:9919:x1876044696014080:12345-192.168.204.41@tcp:700:mkdir.0 Request processed in 82us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.561605:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00080000:0.0:1789135926.561626:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135926.561895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.562756:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696013952 00000100:00100000:0.0:1789135926.562763:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696013952 00000100:00100000:0.0:1789135926.562821:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789135926.562830:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696013952:12345-192.168.204.41@tcp:41:mkdir.0 00000004:00000024:0.0:1789135926.562864:0:8031:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789135926.562981:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696013952:12345-192.168.204.41@tcp:41:mkdir.0 Request processed in 152us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.562988:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:2.0:1789135926.565260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.565391:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014336 00000100:00100000:0.0:1789135926.565400:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014336 00000100:00100000:0.0:1789135926.565449:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:0.0:1789135926.565459:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:9919:x1876044696014336:12345-192.168.204.41@tcp:36:mkdir.0 00010000:00010000:0.0:1789135926.565510:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135926.565572:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf95fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe6a expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.565589:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:0.0:1789135926.565600:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135926.565940:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.565955:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.565964:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.565991:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.566000:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.566007:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135926.570558:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789135926.570585:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570596:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570603:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570608:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135926.570612:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570620:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570638:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789135926.570641:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135926.570646:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.570653:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96122 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135926.570674:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000907875a0 reply state 0000000094e0e879 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135926.570684:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135926.571040:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9919:x1876044696014336:12345-192.168.204.41@tcp:36:mkdir.0 Request processed in 5577us (5782us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789135926.571049:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00010000:00010000:1.0:1789135926.575477:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575495:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575501:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575506:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135926.575511:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575519:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575538:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba06ca52b00) 00010000:00010000:1.0:1789135926.575541:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135926.575545:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135926.575567:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96129 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135926.587629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.587836:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014464 00000100:00100000:0.0:1789135926.587845:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014464 00000100:00100000:0.0:1789135926.587899:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:0.0:1789135926.587908:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:9920:x1876044696014464:12345-192.168.204.41@tcp:101:chmod.0 00010000:00010000:0.0:1789135926.587928:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135926.587950:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fefd expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588011:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588024:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588043:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135926.588113:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789135926.588117:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135926.588161:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588188:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fefd expref: 8 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588272:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fefd expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.588280:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135926.588289:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135926.588293:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135926.589032:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9920:x1876044696014464:12345-192.168.204.41@tcp:101:chmod.0 Request processed in 1122us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.589041:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:0.0:1789135926.605617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.605828:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014720 00000100:00100000:2.0:1789135926.605839:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014720 00000100:00100000:2.0:1789135926.605911:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:2.0:1789135926.605920:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9920:x1876044696014720:12345-192.168.204.41@tcp:36:chmod.0 00010000:00010000:2.0:1789135926.605973:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135926.605998:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fefd expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.606019:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:2.0:1789135926.606204:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135926.606235:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.606250:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.606260:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135926.606561:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000094a6b0fb reply state 00000000e710228d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135926.606570:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789135926.606584:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789135926.612767:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:9920:x1876044696014720:12345-192.168.204.41@tcp:36:chmod.0 Request processed in 6833us (7148us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789135926.612780:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00010000:00010000:3.0:1789135926.622537:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622554:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622561:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622568:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135926.622573:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622580:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622597:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1c2b00) 00010000:00010000:3.0:1789135926.622600:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135926.622605:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.622612:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf9613e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135926.694786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.704136:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014848 00000100:00100000:2.0:1789135926.704152:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014848 00000100:00100000:0.0:1789135926.704761:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:0.0:1789135926.704773:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9921:x1876044696014848:12345-192.168.204.41@tcp:101:chown.0 00010000:00010000:0.0:1789135926.704796:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135926.704821:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff04 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.704892:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.704907:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.704919:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135926.704976:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789135926.704980:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135926.708430:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.708489:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff04 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.708536:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff04 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.708544:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135926.708547:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135926.708550:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135926.708636:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:9921:x1876044696014848:12345-192.168.204.41@tcp:101:chown.0 Request processed in 3864us (13859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.708645:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:1.0:1789135926.716623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.716743:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696014976 00000100:00100000:0.0:1789135926.716752:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696014976 00000100:00100000:0.0:1789135926.716813:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:0.0:1789135926.716823:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:9921:x1876044696014976:12345-192.168.204.41@tcp:101:chown.0 00010000:00010000:0.0:1789135926.716844:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135926.716865:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff0b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.716930:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.716945:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.716958:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.716972:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.716993:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717001:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717227:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717237:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717244:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135926.717295:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789135926.717299:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135926.717320:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717333:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717340:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717346:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717352:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135926.717356:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717370:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717382:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135926.717385:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135926.717390:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717396:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9615a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717409:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717415:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717421:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717426:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135926.717429:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717435:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717442:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba06ca52500) 00010000:00010000:0.0:1789135926.717445:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135926.717448:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717465:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96161 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717498:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff0b expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717512:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff0b expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.717519:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135926.717521:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135926.717524:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030400, rc 0) 00000100:00100000:0.0:1789135926.717813:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:9921:x1876044696014976:12345-192.168.204.41@tcp:101:chown.0 Request processed in 990us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.717821:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789135926.746661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.746861:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696015232 00000100:00100000:0.0:1789135926.746871:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696015232 00000100:00100000:0.0:1789135926.746930:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:0.0:1789135926.746941:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:9921:x1876044696015232:12345-192.168.204.41@tcp:36:chown.0 00010000:00010000:0.0:1789135926.746995:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135926.747024:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff0b expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.747044:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135926.747054:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135926.747090:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.747110:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.747120:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135926.819501:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1789135926.819681:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ea13264b reply state 000000001388d944 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135926.819693:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789135926.819878:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1789135926.819975:0:5852:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1789135926.820156:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820165:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820173:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820187:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135926.820192:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820211:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820229:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52500) 00010000:00010000:3.0:1789135926.820232:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135926.820236:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.820242:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf9616f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135926.820521:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9921:x1876044696015232:12345-192.168.204.41@tcp:36:chown.0 Request processed in 73059us (73361us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789135926.820535:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:2.0:1789135926.867181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135926.867336:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696015360 00000100:00100000:0.0:1789135926.867346:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696015360 00000100:00100000:0.0:1789135926.867409:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:0.0:1789135926.867419:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:9922:x1876044696015360:12345-192.168.204.41@tcp:101:touch.500 00010000:00010000:0.0:1789135926.867445:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135926.867467:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff12 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135926.869663:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2141us 00010000:00010000:0.0:1789135926.912869:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.912896:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.912908:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.912926:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.912933:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.912940:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.914651:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.914669:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.914679:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135926.914924:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135926.914928:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135926.915292:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915307:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915314:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915320:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915326:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135926.915331:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915339:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915352:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135926.915362:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135926.915369:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915375:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9617d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915391:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915396:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915402:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915406:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135926.915409:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915414:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915421:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba06ca52b00) 00010000:00010000:0.0:1789135926.915423:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135926.915425:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.915431:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf96184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.922379:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff12 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.922426:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff12 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.922436:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135926.922439:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789135926.922442:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030800, rc 0) 00000100:00100000:0.0:1789135926.922519:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9922:x1876044696015360:12345-192.168.204.41@tcp:101:touch.500 Request processed in 55101us (55349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135926.922527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:0.0:1789135926.934575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135926.935167:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696015616 00000100:00100000:3.0:1789135926.935178:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696015616 00000100:00100000:3.0:1789135926.935255:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:3.0:1789135926.935265:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:9922:x1876044696015616:12345-192.168.204.41@tcp:101:touch.500 00010000:00010000:3.0:1789135926.935286:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135926.935308:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff19 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935638:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935654:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935666:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935759:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935769:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.935777:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135926.936841:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789135926.937126:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf961a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937138:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf961a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937147:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf961a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937183:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937190:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937197:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937202:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135926.937206:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937224:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937238:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:3.0:1789135926.937241:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135926.937246:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937252:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135926.937265:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c6244ab1 reply state 000000007bf87528 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135926.937274:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135926.937308:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff19 expref: 10 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937323:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf961a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff19 expref: 9 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.937330:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135926.937333:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135926.937336:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5a00, rc 0) 00000100:00100000:3.0:1789135926.937417:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:9922:x1876044696015616:12345-192.168.204.41@tcp:101:touch.500 Request processed in 2153us (2852us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789135926.937426:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 22 00010000:00010000:3.0:1789135926.942775:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942875:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942882:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942887:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135926.942892:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942901:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942919:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8ba05c1e9d00) 00010000:00010000:3.0:1789135926.942922:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135926.942927:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135926.942933:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf961a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135926.947804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.948118:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696015872 00000100:00100000:2.0:1789135926.948128:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696015872 00000100:00100000:2.0:1789135926.948175:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:2.0:1789135926.948183:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:9922:x1876044696015872:12345-192.168.204.41@tcp:36:touch.500 00010000:00010000:2.0:1789135926.948248:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135926.948273:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf961a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff19 expref: 9 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.948288:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135926.948298:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135926.948337:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.948350:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.948359:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135926.948495:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e407dc0e reply state 00000000db6572ff transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135926.948503:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135926.948595:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:9922:x1876044696015872:12345-192.168.204.41@tcp:36:touch.500 Request processed in 411us (809us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789135926.948602:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 23 00010000:00010000:0.0:1789135926.951578:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951600:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951608:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951614:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135926.951619:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951627:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951649:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1c2b00) 00010000:00010000:0.0:1789135926.951667:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135926.951674:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135926.951681:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135926.956071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.956178:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016000 00000100:00100000:2.0:1789135926.956188:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016000 00000100:00100000:2.0:1789135926.956265:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:2.0:1789135926.956275:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:9922:x1876044696016000:12345-192.168.204.41@tcp:101:touch.500 00010000:00010000:2.0:1789135926.956299:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135926.956323:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf961bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff20 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.956384:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf961bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff20 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.956399:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf961bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff20 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135926.956418:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1c2800) 00010000:00010000:2.0:1789135926.956421:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135926.956425:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0fe00, rc 0) 00000100:00100000:2.0:1789135926.956494:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:9922:x1876044696016000:12345-192.168.204.41@tcp:101:touch.500 Request processed in 220us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135926.956501:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:0.0:1789135926.972341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.972450:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016128 00000100:00100000:2.0:1789135926.972461:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016128 00000100:00100000:2.0:1789135926.972548:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:2.0:1789135926.972556:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1876044696016128:12345-192.168.204.41@tcp:8:touch.500 00010000:00080000:2.0:1789135926.972593:0:6700:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:2.0:1789135926.972625:0:6700:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf961c3 00002000:00100000:2.0:1789135926.972638:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8b9f463a6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135926.972663:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135926.973026:0:6700:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135926.973471:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135926.973599:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044696016128:12345-192.168.204.41@tcp:8:touch.500 Request processed in 1041us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135926.973609:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:0.0:1789135926.979678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135926.980244:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016256 00000100:00100000:2.0:1789135926.980255:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016256 00000100:00100000:2.0:1789135926.980445:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:2.0:1789135926.980455:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044696016256:12345-192.168.204.41@tcp:2:touch.500 00000100:00080000:0.0:1789135926.984359:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789135927.058645:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789135927.058663:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000100:00100000:1.0:1789135927.058886:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:0:x1876044696016256:12345-192.168.204.41@tcp:2:touch.500 Request processed in 78426us (79211us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789135927.058912:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:2.0:1789135927.070439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135927.070851:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016512 00000100:00100000:3.0:1789135927.070862:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016512 00000100:00100000:3.0:1789135927.070932:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789135927.070942:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:9922:x1876044696016512:12345-192.168.204.41@tcp:35:touch.500 00000100:00100000:3.0:1789135927.072114:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:9922:x1876044696016512:12345-192.168.204.41@tcp:35:touch.500 Request processed in 1169us (1681us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789135927.072139:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789135927.098737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135927.098879:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016640 00000100:00100000:2.0:1789135927.098904:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016640 00000100:00100000:2.0:1789135927.098965:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:2.0:1789135927.098974:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:9923:x1876044696016640:12345-192.168.204.41@tcp:101:rm.0 00010000:00010000:2.0:1789135927.098996:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135927.099017:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff27 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099113:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099126:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099138:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135927.099195:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789135927.099199:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135927.099260:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099286:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf961ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff27 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099303:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff27 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.099311:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:2.0:1789135927.099314:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135927.099318:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936000, rc 0) 00000100:00100000:2.0:1789135927.099380:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:9923:x1876044696016640:12345-192.168.204.41@tcp:101:rm.0 Request processed in 408us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135927.099388:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:1.0:1789135927.106870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135927.106988:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696016896 00000100:00100000:2.0:1789135927.107009:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696016896 00000100:00100000:2.0:1789135927.107089:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:2.0:1789135927.107100:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:9923:x1876044696016896:12345-192.168.204.41@tcp:101:rm.0 00010000:00010000:2.0:1789135927.107122:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135927.107146:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf961d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff2e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135927.107263:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789135927.107433:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf961d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff2e expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.107448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135927.107457:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135927.107463:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf961d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff2e expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.107476:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937e00, rc 0) 00000100:00100000:2.0:1789135927.107542:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:9923:x1876044696016896:12345-192.168.204.41@tcp:101:rm.0 Request processed in 443us (683us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789135927.107550:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:3.0:1789135927.116092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135927.117775:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017024 00000100:00100000:1.0:1789135927.117788:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017024 00000100:00100000:1.0:1789135927.117858:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789135927.117869:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:9923:x1876044696017024:12345-192.168.204.41@tcp:37:rm.0 00000100:00100000:0.0:1789135927.121608:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:9923:x1876044696017024:12345-192.168.204.41@tcp:37:rm.0 Request processed in 3732us (5527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135927.121620:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00010000:00010000:1.0:1789135927.122691:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135927.138115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135927.141141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017280 00000100:00100000:3.0:1789135927.141156:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017280 00000100:00100000:3.0:1789135927.141299:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:3.0:1789135927.141311:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:9923:x1876044696017280:12345-192.168.204.41@tcp:35:rm.0 00000100:00100000:3.0:1789135927.141622:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:9923:x1876044696017280:12345-192.168.204.41@tcp:35:rm.0 Request processed in 313us (3516us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789135927.141630:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:3.0:1789135927.152208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135927.152320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135927.152428:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017536 00000100:00100000:2.0:1789135927.152438:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017536 00000100:00100000:2.0:1789135927.152519:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:2.0:1789135927.152529:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696017536:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135927.152604:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696017536:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 76us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135927.152612:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:1.0:1789135927.153007:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017408 00000100:00100000:1.0:1789135927.153012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017408 00000100:00100000:1.0:1789135927.153090:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 283 00000100:00100000:1.0:1789135927.153099:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696017408:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:0.0:1789135927.153117:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135927.153158:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696017408:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 60us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135927.153166:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 283 00000100:00100000:3.0:1789135927.156397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135927.156615:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017792 00000100:00100000:0.0:1789135927.156625:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017792 00000100:00100000:0.0:1789135927.156687:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:0.0:1789135927.156733:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:9923:x1876044696017792:12345-192.168.204.41@tcp:101:rm.0 00010000:00010000:0.0:1789135927.156759:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135927.156780:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf961e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff35 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.156969:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf961ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.156984:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf961ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.157013:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf961ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135927.157025:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789135927.157315:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf961e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff35 expref: 17 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.157334:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf961ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff35 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.157343:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135927.157345:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135927.157348:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030600, rc 0) 00000100:00100000:0.0:1789135927.157408:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696017792:12345-192.168.204.41@tcp:101:rm.0 Request processed in 712us (1020us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789135927.157416:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:2.0:1789135927.165430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135927.165726:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696017920 00000100:00100000:0.0:1789135927.165736:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696017920 00000100:00100000:0.0:1789135927.165851:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:0.0:1789135927.165861:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696017920:12345-192.168.204.41@tcp:41:rm.0 00000004:00000024:0.0:1789135927.165917:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789135927.165991:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696017920:12345-192.168.204.41@tcp:41:rm.0 Request processed in 132us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135927.165999:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789135927.168815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135927.168945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696018048 00000100:00100000:1.0:1789135927.168954:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696018048 00000100:00100000:1.0:1789135927.169008:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:1.0:1789135927.169016:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696018048:12345-192.168.204.41@tcp:101:rm.0 00010000:00010000:1.0:1789135927.169035:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135927.169055:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf961fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff3c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169126:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169141:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169153:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169170:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169176:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169183:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169294:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169311:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169318:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135927.169344:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789135927.169349:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135927.169367:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169378:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169387:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169394:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169401:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169407:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135927.169411:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169417:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169428:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:1.0:1789135927.169431:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135927.169440:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169447:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169460:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169466:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169472:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169478:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135927.169480:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169485:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169493:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8ba069d75f00) 00010000:00010000:1.0:1789135927.169495:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135927.169498:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169504:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf96209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169531:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf961fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff3c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169554:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff3c expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.169561:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1c2800) 00010000:00010000:1.0:1789135927.169563:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135927.169566:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8400, rc 0) 00000100:00100000:1.0:1789135927.169627:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:9923:x1876044696018048:12345-192.168.204.41@tcp:101:rm.0 Request processed in 611us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135927.169635:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:2.0:1789135927.174970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135927.175058:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696018304 00000100:00100000:0.0:1789135927.175066:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696018304 00000100:00100000:0.0:1789135927.175152:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:0.0:1789135927.175161:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:9923:x1876044696018304:12345-192.168.204.41@tcp:36:rm.0 00010000:00010000:0.0:1789135927.175224:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789135927.175250:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8400/0x38eb79866bf96210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff3c expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175269:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf961bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff20 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175280:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba05c1c2800) 00010000:00010000:0.0:1789135927.175294:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf961d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff27 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175302:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135927.175305:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135927.175323:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175336:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175345:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175358:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175364:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175382:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175518:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175526:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.175534:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135927.176243:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789135927.176254:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401050552861ns, next at 402050550502ns, rc = 0 00010000:00010000:0.0:1789135927.176306:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176316:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176324:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176332:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176339:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176346:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176383:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135927.176401:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176408:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176415:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176420:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135927.176424:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176432:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176441:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:0.0:1789135927.176443:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789135927.176447:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176454:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96225 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176469:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176475:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176481:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176490:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135927.176493:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176500:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176507:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135927.176510:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135927.176512:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135927.176517:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135927.176527:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000077132af9 reply state 00000000d08e1036 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135927.176535:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135927.176601:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696018304:12345-192.168.204.41@tcp:36:rm.0 Request processed in 1440us (1639us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789135927.176609:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 30 00010000:00010000:2.0:1789135927.177155:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135927.177162:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.177169:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cd800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135927.177173:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.177180:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.177211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:2.0:1789135927.177214:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789135927.177217:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.177223:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf9622c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135927.177238:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135927.177240:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135927.177242:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135927.179477:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179493:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179500:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179506:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135927.179510:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179518:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179545:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135927.179548:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135927.179553:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.179560:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf9621e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135927.182935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135927.183323:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696018560 00000100:00100000:3.0:1789135927.183333:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696018560 00000100:00100000:3.0:1789135927.183467:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:3.0:1789135927.183477:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:9923:x1876044696018560:12345-192.168.204.41@tcp:35:rm.0 00000100:00100000:3.0:1789135927.183751:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696018560:12345-192.168.204.41@tcp:35:rm.0 Request processed in 274us (824us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789135927.183759:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:2.0:1789135927.186178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135927.186638:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696018816 00000100:00100000:1.0:1789135927.186647:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696018816 00000100:00100000:1.0:1789135927.186764:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 31 00000100:00100000:1.0:1789135927.186774:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:9923:x1876044696018816:12345-192.168.204.41@tcp:36:rm.0 00010000:00010000:1.0:1789135927.186834:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135927.186859:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf961ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff35 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186878:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9618b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff12 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186888:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba06ca52a00) 00010000:00010000:1.0:1789135927.186901:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9614c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff04 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186910:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789135927.186929:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135927.186952:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186964:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186973:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186984:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186992:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.186998:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187306:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187315:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187322:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135927.187898:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789135927.187915:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187922:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187935:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187940:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135927.187944:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187953:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187962:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ba069d75800) 00010000:00010000:1.0:1789135927.187965:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135927.187969:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187975:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf96241 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187992:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.187998:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.188004:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.188009:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135927.188012:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.188027:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.188034:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75f00) 00010000:00010000:1.0:1789135927.188036:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135927.188039:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135927.188046:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec8c00/0x38eb79866bf96233 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135927.188056:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f0b08a9a reply state 00000000c01210c6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135927.188065:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135927.188157:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:9923:x1876044696018816:12345-192.168.204.41@tcp:36:rm.0 Request processed in 1382us (1986us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789135927.188165:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 31 00010000:00010000:3.0:1789135927.190106:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190126:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190134:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190140:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135927.190145:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190152:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190178:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ba069d75a00) 00010000:00010000:3.0:1789135927.190181:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135927.190186:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135927.190207:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9a00/0x38eb79866bf9623a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135927.501300:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723317888:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135927.501442:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723318400:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135927.501498:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789135927.501503:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723317760:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135927.501545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723318272:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501563:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135927.501588:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318400 00000100:00100000:3.0:1789135927.501594:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318400 00000100:00100000:3.0:1789135927.501639:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135927.501648:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723318400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501696:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723318400:12345-0@lo:400:kworker.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135927.501738:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135927.501762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317760 00000100:00100000:3.0:1789135927.501765:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317760 00000100:00100000:3.0:1789135927.501799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789135927.501820:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723317760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723317760:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135927.501856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789135927.501883:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723317888 00000100:00100000:3.0:1789135927.501886:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723317888 00000100:00100000:3.0:1789135927.501904:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318272 00000100:00100000:3.0:1789135927.501906:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318272 00000100:00100000:3.0:1789135927.501935:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789135927.501941:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723317888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.501967:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723317888:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135927.501973:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789135927.501984:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789135927.505368:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723318272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.505471:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723318272:12345-0@lo:400:kworker.0 Request processed in 3479us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135927.505481:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789135927.505643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723317760:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.505657:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723318272:0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.505668:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723317888:0@lo:400:kworker.0 00010000:00080000:3.0:1789135927.505681:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f12d00 x1876044723318400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135927.505692:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723318400:0@lo:400:kworker.0 00000100:00080000:0.0:1789135927.505850:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135927.505857:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135927.507183:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723318016:0@lo:400:kworker.0 00000100:00100000:2.0:1789135927.507236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135927.507274:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135927.507298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135927.507325:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135927.507331:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723318144:0@lo:400:kworker.0 00000100:00100000:2.0:1789135927.507352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135927.507472:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318016 00000100:00100000:3.0:1789135927.507479:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318016 00000100:00100000:3.0:1789135927.507525:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789135927.507532:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723318016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135927.507578:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723318016:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135927.507585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789135927.507631:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723318016:0@lo:400:kworker.0 00000100:00100000:0.0:1789135927.508594:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318528 00000100:00100000:0.0:1789135927.508601:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318528 00000100:00100000:0.0:1789135927.508647:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135927.508655:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723318528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135927.508685:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135927.508772:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723318528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135927.508779:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789135927.508798:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135927.508834:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0741ce940 x1876044723318528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135927.508851:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135927.514129:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318144 00000100:00100000:1.0:1789135927.514143:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318144 00000100:00100000:1.0:1789135927.514227:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135927.514237:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723318144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135927.514329:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723318144:12345-0@lo:400:kworker.0 Request processed in 94us (6975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135927.514337:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789135927.514385:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f13840 x1876044723318144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135927.514399:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723318144:0@lo:400:kworker.0 00000100:00080000:0.0:1789135927.514595:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135928.015092:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723318656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135928.015182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135928.015257:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318656 00000100:00100000:3.0:1789135928.015264:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318656 00000100:00100000:3.0:1789135928.015305:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789135928.015313:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723318656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135928.015337:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135928.015375:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723318656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135928.015382:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789135928.015418:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0741cf0c0 x1876044723318656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135928.015435:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723318656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135928.142044:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135929.164876:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135930.191383:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135931.214907:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135931.758247:0:12039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1789135932.216938:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1789135932.216955:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789135932.216999:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1789135932.219047:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0743021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723318784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135932.219134:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.219416:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318784 00000100:00100000:1.0:1789135932.219423:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318784 00000100:00100000:1.0:1789135932.219484:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135932.219493:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723318784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789135932.219518:0:8442:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789135932.219550:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa40c36, atime: 0x6aa40c36, ctime: 0x6aa40c36, blocks: 0x1 00010000:00010000:1.0:1789135932.219558:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.219574:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1789135932.219578:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135932.219584:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.219600:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.219611:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.219619:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.219634:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135932.220353:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723318784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 857us (1216us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789135932.220362:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789135932.220463:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135932.220614:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135932.220623:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.220644:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789135932.220648:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.220659:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.220683:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.220691:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51d1847/0x38eb79866bf96248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.220751:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.220754:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.220755:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789135932.220797:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba0743021c0/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789135932.220804:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0743021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723318784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789135932.239087:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135932.274876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135932.274913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135932.274954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135932.274993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135932.275023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696018944 00000100:00100000:2.0:1789135932.275033:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696018944 00000100:00100000:2.0:1789135932.275079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 285 00000100:00100000:2.0:1789135932.275089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696018944:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135932.275155:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696018944:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.275162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 285 00000100:00100000:1.0:1789135932.275262:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019072 00000100:00100000:1.0:1789135932.275267:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019072 00000100:00100000:1.0:1789135932.275305:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019328 00000100:00100000:1.0:1789135932.275308:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019328 00000100:00100000:1.0:1789135932.275327:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 127 00000100:00100000:1.0:1789135932.275333:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696019072:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135932.275368:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696019072:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.275375:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 127 00000100:00100000:1.0:1789135932.275389:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 128 00000100:00100000:1.0:1789135932.275396:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696019328:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135932.275418:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696019328:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.275424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 128 00000100:00100000:3.0:1789135932.275605:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019200 00000100:00100000:3.0:1789135932.275610:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019200 00000100:00100000:3.0:1789135932.275642:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:3.0:1789135932.275648:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696019200:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:0.0:1789135932.275671:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135932.275676:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696019200:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00080000:0.0:1789135932.275676:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135932.275689:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:2.0:1789135932.624328:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723318912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135932.624460:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.624561:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723318912 00000100:00100000:2.0:1789135932.624572:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723318912 00000100:00100000:2.0:1789135932.624638:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135932.624650:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723318912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135932.624728:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135932.624791:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723318912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.624800:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1789135932.624855:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0741ce1c0 x1876044723318912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135932.624878:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723318912:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789135932.625078:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135932.625306:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723319040:0@lo:400:kworker.0 00000100:00100000:0.0:1789135932.625356:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.625397:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135932.625404:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723319168:0@lo:400:kworker.0 00000100:00100000:0.0:1789135932.625435:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.625466:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319168 00000100:00100000:0.0:1789135932.625471:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319168 00000100:00100000:0.0:1789135932.625512:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789135932.625520:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135932.625565:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723319168:12345-0@lo:400:kworker.0 Request processed in 46us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.625572:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789135932.625607:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723319168:0@lo:400:kworker.0 00000100:00100000:1.0:1789135932.625666:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319040 00000100:00100000:1.0:1789135932.625671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319040 00000100:00100000:1.0:1789135932.625734:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789135932.625742:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723319040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135932.625784:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723319040:12345-0@lo:400:kworker.0 Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.625792:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789135932.626200:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723319040:0@lo:400:kworker.0 00000100:00100000:2.0:1789135932.627881:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723319296:0@lo:400:kworker.0 00000100:00100000:2.0:1789135932.628009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.628069:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135932.628095:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723319424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135932.628126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.628266:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319296 00000100:00100000:1.0:1789135932.628276:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319296 00000100:00100000:1.0:1789135932.628354:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319424 00000100:00100000:1.0:1789135932.628357:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319424 00000100:00100000:1.0:1789135932.628382:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135932.628392:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723319296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135932.628466:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723319296:12345-0@lo:400:kworker.0 Request processed in 76us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.628474:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135932.628494:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135932.628500:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723319424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135932.628527:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723319424:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.628533:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789135932.628668:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135932.628743:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723319424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135932.628758:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723319296:0@lo:400:kworker.0 00000020:00000080:3.0:1789135932.947033:0:12088:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4cbc8810 20000000:00000080:3.0:1789135932.947052:0:12088:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba059389000 uarg=0000000000000000 20000000:01000000:3.0:1789135932.947096:0:12088:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789135932.947104:0:12088:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789135932.947109:0:12088:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789135932.948128:0:12089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789135932.948298:0:12088:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789135932.953158:0:12088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:3.0:1789135932.953237:0:12088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:3.0:1789135932.953281:0:12088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:3.0:1789135932.953302:0:12088:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789135932.953324:0:12088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953344:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960ea expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953353:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953360:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96106 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953370:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953378:0:12088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953400:0:12088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953443:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953459:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 12 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.953476:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319552:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135932.953600:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953609:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.953617:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319680:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135932.953649:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953657:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 18 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.953666:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319808:0@lo:104: 00000100:00100000:3.0:1789135932.953728:0:12088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135932.953760:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.953778:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 18 pid: 5843 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.953787:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319936:0@lo:104: 00000100:00100000:3.0:1789135932.953812:0:12088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.953847:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319808 00000100:00100000:3.0:1789135932.953854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319808 00000100:00100000:3.0:1789135932.953895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723319936 00000100:00100000:3.0:1789135932.953898:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723319936 00000100:00100000:3.0:1789135932.953918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135932.953927:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:12088:x1876044723319808:12345-0@lo:104: 00010000:00010000:3.0:1789135932.953940:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954002:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135932.954008:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+4:12088:x1876044723319808:12345-0@lo:104: Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.954015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135932.954035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135932.954042:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:12088:x1876044723319936:12345-0@lo:104: 00010000:00010000:3.0:1789135932.954051:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954083:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135932.954089:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:12088:x1876044723319936:12345-0@lo:104: Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.954095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789135932.954122:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135932.954128:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954135:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135932.954139:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954148:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135932.954156:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135932.954162:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135932.954189:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954195:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135932.954219:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954226:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf96106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9610d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954240:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135932.954243:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954249:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0fc00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135932.954252:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954265:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135932.954271:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135932.954277:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135932.954307:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954313:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135932.954320:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954328:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf960f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954338:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.954340:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.954342:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.954361:0:12088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954370:0:12088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 18 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.954379:0:12088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723320320:0@lo:104: 00000100:00100000:3.0:1789135932.954404:0:12088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.954424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320320 00000100:00100000:3.0:1789135932.954433:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320320 00000100:00100000:3.0:1789135932.954452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135932.954458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:12088:x1876044723320320:12345-0@lo:104: 00010000:00010000:3.0:1789135932.954466:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954501:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135932.954506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+3:12088:x1876044723320320:12345-0@lo:104: Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.954513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789135932.954528:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135932.954532:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954538:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4600 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789135932.954541:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954548:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135932.954554:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135932.954559:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135932.954574:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954580:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135932.954591:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954604:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf960ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf960f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.954616:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.954617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135932.954619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135932.954628:0:12088:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.954650:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319808:0@lo:104: 00000100:00100000:3.0:1789135932.954659:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319936:0@lo:104: 00000100:00100000:3.0:1789135932.954664:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723320320:0@lo:104: 00010000:00010000:2.0:1789135932.955026:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135932.955049:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723320192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135932.955082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.955118:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135932.955124:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723320064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135932.955145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.955172:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723320448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135932.955212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.955248:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320192 00000100:00100000:2.0:1789135932.955253:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320192 00010000:00010000:2.0:1789135932.955275:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 19 pid: 5843 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135932.955296:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320064 00000100:00100000:2.0:1789135932.955300:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320064 00010000:00010000:2.0:1789135932.955312:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 20 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135932.955323:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320448 00000100:00100000:2.0:1789135932.955326:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320448 00010000:00010000:2.0:1789135932.955337:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 21 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135932.955350:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135932.955365:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+21:3314:x1876044723320192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135932.955377:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135932.955383:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 21 pid: 5843 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955393:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 21 pid: 5843 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955407:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf960ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf960f8 expref: 21 pid: 5843 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955422:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135932.955454:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+20:3314:x1876044723320192:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.955461:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135932.955477:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135932.955483:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723320064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135932.955491:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135932.955496:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 19 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955504:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 19 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955515:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf9610d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf96106 expref: 19 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955524:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135932.955548:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3314:x1876044723320064:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.955561:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135932.955574:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135932.955580:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3311:x1876044723320448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135932.955588:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135932.955592:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 17 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955601:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 17 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955610:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0ee00/0x38eb79866bf960f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf960ea expref: 17 pid: 5842 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.955620:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135932.955645:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3311:x1876044723320448:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.955652:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135932.955687:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723320448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135932.955747:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723320064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135932.955755:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723320192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135932.961274:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319552:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135932.963113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135932.963154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135932.963222:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019456 00000100:00100000:0.0:1789135932.963230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019456 00010000:00010000:0.0:1789135932.963273:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 13 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135932.963310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019584 00000100:00100000:0.0:1789135932.963314:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019584 00010000:00010000:0.0:1789135932.963327:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 14 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135932.963348:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:0.0:1789135932.963357:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+14:2364:x1876044696019456:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135932.963370:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135932.963374:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 14 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963386:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 14 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963406:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf9611b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fef6 expref: 14 pid: 5842 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963421:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135932.963472:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696019456:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 116us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.963480:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:0.0:1789135932.963497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:0.0:1789135932.963503:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696019584:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135932.963525:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135932.963530:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963538:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 12 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963550:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963559:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963573:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963580:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963587:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963595:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963600:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135932.963604:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963612:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963632:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.963643:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135932.963662:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696019584:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 160us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.963669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00010000:00010000:1.0:1789135932.963950:0:12088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9800/0x38eb79866bf96114 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feef expref: 11 pid: 5844 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135932.963971:0:12088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12088:1876044723319680:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135932.964002:0:12088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.964010:0:12088:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.964016:0:12088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.964022:0:12088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5e00/0x38eb79866bf9624f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135933.150248:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135933.150273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723320576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135933.150349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.150417:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320576 00000100:00100000:1.0:1789135933.150435:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320576 00000100:00100000:1.0:1789135933.150483:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135933.150491:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723320576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135933.150531:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135933.150581:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723320576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135933.150587:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135933.150640:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723320576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135933.261031:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135934.285285:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135934.769592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135934.770095:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019712 00000100:00100000:3.0:1789135934.770106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019712 00000100:00100000:3.0:1789135934.770177:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 287 00000100:00100000:3.0:1789135934.770189:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:5611:x1876044696019712:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135934.770208:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135934.770231:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4600/0x38eb79866bf96256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff43 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135934.770267:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4600/0x38eb79866bf96256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff43 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135934.770281:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4600/0x38eb79866bf96256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff43 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135934.770309:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4600, rc 0) 00000100:00100000:3.0:1789135934.770391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696019712:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 202us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.770398:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 287 00000100:00100000:3.0:1789135934.772937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135934.773321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019840 00000100:00100000:0.0:1789135934.773340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019840 00000100:00100000:0.0:1789135934.773438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 288 00000100:00100000:0.0:1789135934.773450:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696019840:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135934.773852:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696019840:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 402us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135934.773860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 288 00000100:00100000:2.0:1789135934.784293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135934.784499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696019968 00000100:00100000:1.0:1789135934.784509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696019968 00000100:00100000:1.0:1789135934.784570:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 289 00000100:00100000:1.0:1789135934.784580:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696019968:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135934.784856:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696019968:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 278us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.784864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 289 00000100:00100000:1.0:1789135934.793029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135934.793782:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020096 00000100:00100000:0.0:1789135934.793796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020096 00000100:00100000:0.0:1789135934.793865:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 290 00000100:00100000:0.0:1789135934.793876:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:10193:x1876044696020096:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135934.794616:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:10193:x1876044696020096:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 737us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135934.794629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 290 00000100:00100000:2.0:1789135934.817120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135934.817486:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020224 00000100:00100000:3.0:1789135934.817499:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020224 00000100:00100000:3.0:1789135934.817618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 291 00000100:00100000:3.0:1789135934.817631:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:10193:x1876044696020224:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135934.818093:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:10193:x1876044696020224:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 463us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.818104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 291 00000100:00100000:2.0:1789135934.830561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135934.831576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020352 00000100:00100000:0.0:1789135934.831591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020352 00000100:00100000:0.0:1789135934.831678:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 292 00000100:00100000:0.0:1789135934.831691:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:5611:x1876044696020352:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135934.831775:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135934.831800:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf9625d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff4a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135934.831838:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf9625d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff4a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135934.831852:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf9625d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff4a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135934.831863:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc600, rc 0) 00000100:00100000:0.0:1789135934.831957:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696020352:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 268us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135934.831964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 292 00000100:00100000:0.0:1789135934.841499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135934.841603:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020480 00000100:00100000:3.0:1789135934.841616:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020480 00000100:00100000:3.0:1789135934.841683:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 293 00000100:00100000:3.0:1789135934.841693:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696020480:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135934.842114:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696020480:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 420us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.842132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 293 00000100:00100000:2.0:1789135934.844003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135934.844093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020608 00000100:00100000:1.0:1789135934.844103:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020608 00000100:00100000:1.0:1789135934.844176:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 294 00000100:00100000:1.0:1789135934.844188:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696020608:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135934.844809:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:5611:x1876044696020608:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 618us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.844822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 294 00000100:00100000:2.0:1789135934.847896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135934.848015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020736 00000100:00100000:0.0:1789135934.848028:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020736 00000100:00100000:0.0:1789135934.848109:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 295 00000100:00100000:0.0:1789135934.848136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:10196:x1876044696020736:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135934.848676:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:10196:x1876044696020736:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 554us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135934.848687:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 295 00000100:00100000:0.0:1789135934.858854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135934.862379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020864 00000100:00100000:1.0:1789135934.862402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020864 00000100:00100000:1.0:1789135934.862584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 296 00000100:00100000:1.0:1789135934.862615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:10196:x1876044696020864:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135934.863000:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:10196:x1876044696020864:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 386us (4161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.863009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 296 10000000:01000000:0.0:1789135934.989253:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135934.989265:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b9f45966800 from 10 10000000:01000000:0.0:1789135934.989273:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135934.989346:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135934.989381:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135934.989397:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135934.989433:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135934.989533:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135934.989673:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135934.989830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320704 00000100:00100000:1.0:1789135934.989840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320704 00000100:00100000:1.0:1789135934.989905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789135934.990089:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:5846:x1876044723320704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135934.990108:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135934.990125:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf9626b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96264 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135934.990154:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf9626b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96264 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135934.990167:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf9626b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96264 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135934.990177:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec9a00, rc 0) 00000100:00100000:1.0:1789135934.990241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723320704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.990248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789135934.990796:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135934.990821:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135934.990832:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135934.991064:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135934.991115:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135934.991165:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069e09a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135934.992194:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320832 00000100:00100000:3.0:1789135934.992207:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320832 00000100:00100000:3.0:1789135934.992285:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789135934.992299:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723320832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135934.994838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723320832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2530us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.994865:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789135934.995336:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135934.995426:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135934.995497:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135934.995557:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069e09a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135934.995761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723320960 00000100:00100000:0.0:1789135934.995771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723320960 00000100:00100000:0.0:1789135934.996020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789135934.996033:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723320960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135934.996303:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723320960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135934.996312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789135934.996454:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723320960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135934.998358:0:12102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12102:1876044723321088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135934.998477:0:12102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135934.998537:0:12102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135934.998815:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321088 00000100:00100000:3.0:1789135934.998827:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321088 00000100:00100000:3.0:1789135934.998905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789135934.999027:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:12102:x1876044723321088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135934.999341:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:12102:x1876044723321088:12345-0@lo:502:llog_process_th.0 Request processed in 317us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.999350:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789135935.001912:0:12102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12102:1876044723321088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135935.002011:0:12102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135935.002027:0:12102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135935.002030:0:12102:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135935.002039:0:12102:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b9f45966800 00000020:00000080:1.0:1789135935.002042:0:12102:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135935.002192:0:12102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12102:1876044723321216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135935.002278:0:12102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.002333:0:12102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135935.004784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321216 00000100:00100000:3.0:1789135935.004804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321216 00000100:00100000:3.0:1789135935.004897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789135935.004910:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:12102:x1876044723321216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135935.005355:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:12102:x1876044723321216:12345-0@lo:502:llog_process_th.0 Request processed in 445us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135935.005365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789135935.005879:0:12102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12102:1876044723321216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135935.005941:0:12102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135935.005952:0:12102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135935.005954:0:12102:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789135935.005961:0:12102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789135935.006204:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789135935.006243:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135935.006259:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.006273:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135935.006286:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135935.006289:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba0504e6000 from 10 10000000:01000000:0.0:1789135935.006292:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135935.006336:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.006354:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.006366:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135935.006395:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.006470:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135935.006526:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135935.007838:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321344 00000100:00100000:1.0:1789135935.007852:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321344 00000100:00100000:1.0:1789135935.007932:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789135935.007944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:5846:x1876044723321344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135935.007966:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135935.007987:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba044ec8400/0x38eb79866bf96279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96272 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.008020:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba044ec8400/0x38eb79866bf96279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96272 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.008033:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba044ec8400/0x38eb79866bf96279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96272 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.008044:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba044ec8400, rc 0) 00000100:00100000:1.0:1789135935.008131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135935.008139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789135935.008492:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135935.008522:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.008533:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135935.009825:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.009910:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135935.009978:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135935.011371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321472 00000100:00100000:1.0:1789135935.011389:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321472 00000100:00100000:1.0:1789135935.011463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789135935.011475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.013865:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.013979:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.014061:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135935.014118:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044d85780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135935.014266:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2095us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135935.014282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789135935.014333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321600 00000100:00100000:1.0:1789135935.014341:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321600 00000100:00100000:1.0:1789135935.014384:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789135935.014394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.014696:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135935.014725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789135935.014839:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135935.018254:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12104:1876044723321728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135935.018400:0:12104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135935.018473:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069e09900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135935.018558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321728 00000100:00100000:0.0:1789135935.018576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321728 00000100:00100000:0.0:1789135935.018664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789135935.018675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:12104:x1876044723321728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135935.019058:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:12104:x1876044723321728:12345-0@lo:502:llog_process_th.0 Request processed in 383us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135935.019067:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789135935.019314:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12104:1876044723321728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135935.019354:0:12104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135935.019367:0:12104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135935.019369:0:12104:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789135935.019378:0:12104:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba0504e6000 00000020:00000080:2.0:1789135935.019388:0:12104:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135935.019497:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12104:1876044723321856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135935.019552:0:12104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135935.019585:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069e09900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135935.019682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321856 00000100:00100000:1.0:1789135935.019689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321856 00000100:00100000:1.0:1789135935.019768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789135935.019779:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:12104:x1876044723321856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135935.020005:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:12104:x1876044723321856:12345-0@lo:502:llog_process_th.0 Request processed in 227us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135935.020013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789135935.020234:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12104:1876044723321856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135935.020263:0:12104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135935.020269:0:12104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135935.020271:0:12104:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789135935.020275:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789135935.021437:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789135935.021489:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135935.021506:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.021530:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135935.021544:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135935.021547:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba04857c800 from 10 10000000:01000000:1.0:1789135935.021551:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135935.021618:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.021628:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.021650:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135935.021679:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.021776:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.021818:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135935.022786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723321984 00000100:00100000:0.0:1789135935.022799:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723321984 00000100:00100000:0.0:1789135935.022879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789135935.022893:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:5846:x1876044723321984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135935.022915:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135935.022948:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf96287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf96280 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.022985:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf96287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf96280 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.022998:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf96287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf96280 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135935.023010:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cdc00, rc 0) 00000100:00100000:0.0:1789135935.023091:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723321984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135935.023099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789135935.024798:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723321984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135935.024834:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.024849:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135935.024969:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.025051:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.025122:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135935.028024:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322112 00000100:00100000:0.0:1789135935.028044:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322112 00000100:00100000:0.0:1789135935.028137:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789135935.028150:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723322112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.028530:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723322112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135935.028547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789135935.028617:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.028752:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723322240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.035041:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.035138:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135935.035850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322240 00000100:00100000:0.0:1789135935.035863:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322240 00000100:00100000:0.0:1789135935.035945:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789135935.035958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723322240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135935.036302:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:5846:x1876044723322240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 344us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135935.036312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789135935.036883:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:5846:1876044723322240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135935.037222:0:12106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12106:1876044723322368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135935.037287:0:12106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.037326:0:12106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135935.038893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322368 00000100:00100000:0.0:1789135935.038909:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322368 00000100:00100000:0.0:1789135935.038993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789135935.039004:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:12106:x1876044723322368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135935.039349:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:12106:x1876044723322368:12345-0@lo:502:llog_process_th.0 Request processed in 345us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135935.039359:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789135935.039807:0:12106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12106:1876044723322368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135935.039856:0:12106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135935.039871:0:12106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135935.039874:0:12106:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135935.039885:0:12106:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba04857c800 00000020:00000080:1.0:1789135935.039890:0:12106:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135935.040036:0:12106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12106:1876044723322496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135935.040097:0:12106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135935.040136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322496 00000100:00100000:1.0:1789135935.040142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322496 00000100:00100000:1.0:1789135935.040176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789135935.040184:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:12106:x1876044723322496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135935.040380:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:12106:x1876044723322496:12345-0@lo:502:llog_process_th.0 Request processed in 194us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135935.040388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789135935.040436:0:12106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135935.040459:0:12106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738be580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:12106:1876044723322496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135935.040479:0:12106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135935.040484:0:12106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135935.040486:0:12106:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789135935.040490:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789135935.042833:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789135935.042884:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135935.042898:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135935.042913:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135935.055687:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135935.312971:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135936.081605:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789135936.335845:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135937.357093:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135937.391520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135937.391675:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021120 00000100:00100000:0.0:1789135937.391686:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021120 00000100:00100000:0.0:1789135937.391776:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 132 00000100:00100000:0.0:1789135937.391802:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696021120:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135937.391896:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696021120:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 111us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135937.391903:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 132 00000100:00080000:3.0:1789135937.392408:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789135937.392593:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1789135937.396342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135937.396399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135937.396593:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021376 00000100:00100000:0.0:1789135937.396604:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021376 00000100:00100000:0.0:1789135937.396679:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 133 00000100:00100000:0.0:1789135937.396732:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696021376:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135937.396809:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696021376:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 106us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135937.396817:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 133 00000100:00080000:2.0:1789135937.397530:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135937.398294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696020992 00000100:00100000:1.0:1789135937.398312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696020992 00000100:00100000:3.0:1789135937.399036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135937.399153:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021248 00000100:00100000:1.0:1789135937.399158:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021248 00000100:00100000:1.0:1789135937.399213:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:1.0:1789135937.399222:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696021248:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135937.399283:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696021248:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135937.399289:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00080000:2.0:1789135937.399509:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135937.402754:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 312 00000100:00100000:0.0:1789135937.402768:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696020992:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135937.402988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696020992:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 222us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135937.405244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 312 00000100:00100000:3.0:1789135937.741311:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135937.741340:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723322624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135937.741416:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135937.741759:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322624 00000100:00100000:1.0:1789135937.741767:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322624 00000100:00100000:1.0:1789135937.741836:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789135937.741846:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723322624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135937.741913:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135937.741964:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723322624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135937.741972:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789135937.742031:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0732e0000 x1876044723322624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135937.742049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723322624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135937.742257:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723323008:0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.742301:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135937.742326:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135937.742332:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723322880:0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.742354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135937.742379:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323008 00000100:00100000:2.0:1789135937.742383:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323008 00000100:00100000:2.0:1789135937.742413:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322880 00000100:00100000:2.0:1789135937.742415:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322880 00000100:00100000:2.0:1789135937.742434:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135937.742440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723323008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.742478:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723323008:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135937.742496:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135937.742509:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135937.742516:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723322880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.742544:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723322880:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135937.742549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135937.742578:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723322880:0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.742604:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723323008:0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.742883:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723323136:0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.742918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135937.742939:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135937.742945:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723322752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.742974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135937.743012:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723323264:0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.743036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135937.743069:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323264 00000100:00100000:0.0:1789135937.743072:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323264 00000100:00100000:0.0:1789135937.743100:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789135937.743107:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723323264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.743143:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723323264:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135937.743149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789135937.743175:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723323264:0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.743207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723322752 00000100:00100000:0.0:1789135937.743211:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723322752 00000100:00100000:0.0:1789135937.743235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789135937.743242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723322752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135937.743279:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723322752:12345-0@lo:400:kworker.0 Request processed in 37us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135937.743285:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789135937.743314:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723322752:0@lo:400:kworker.0 00000100:00080000:3.0:1789135937.743561:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135937.743565:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135937.743885:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323136 00000100:00100000:2.0:1789135937.743890:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323136 00000100:00100000:2.0:1789135937.743940:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135937.743948:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723323136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135937.744014:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723323136:12345-0@lo:400:kworker.0 Request processed in 67us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135937.744021:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135937.744144:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789135937.744151:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba0743021c0, transno 4294967300 00000100:00100000:1.0:1789135937.744170:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723323136:0@lo:400:kworker.0 00000100:00080000:3.0:1789135937.744227:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135938.254433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135938.254456:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135938.254529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135938.254729:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323392 00000100:00100000:3.0:1789135938.254737:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323392 00000100:00100000:3.0:1789135938.254799:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135938.254808:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723323392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135938.254856:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135938.254923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723323392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135938.254931:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789135938.255319:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723323392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135938.380871:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135939.407615:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135940.429084:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135941.453635:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135942.477387:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135942.511639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135942.511885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135942.512063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135942.512109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135942.512241:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021632 00000100:00100000:0.0:1789135942.512254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021632 00000100:00100000:0.0:1789135942.512328:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021888 00000100:00100000:0.0:1789135942.512331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021888 00000100:00100000:0.0:1789135942.512354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 137 00000100:00100000:0.0:1789135942.512364:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696021632:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135942.512565:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021504 00000100:00100000:1.0:1789135942.512570:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021504 00000100:00100000:1.0:1789135942.512603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 314 00000100:00100000:1.0:1789135942.512611:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696021504:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135942.512728:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 138 00000100:00100000:2.0:1789135942.512739:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696021888:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135942.514977:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696021632:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 2597us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135942.514996:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 137 00000100:00080000:0.0:1789135942.515143:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135942.518389:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696021504:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 5758us (6304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135942.518408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 314 00000100:00100000:1.0:1789135942.518566:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696021760 00000100:00100000:1.0:1789135942.518577:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696021760 00000100:00100000:1.0:1789135942.518662:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00100000:1.0:1789135942.518674:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696021760:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135942.518808:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696021760:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 136us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135942.518817:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00080000:1.0:1789135942.518866:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135942.523952:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696021888:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 11195us (12046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135942.523974:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 138 00000100:00100000:0.0:1789135942.862930:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723323520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135942.863047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135942.864611:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323520 00000100:00100000:2.0:1789135942.864625:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323520 00000100:00100000:2.0:1789135942.864746:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135942.864759:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723323520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135942.864824:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135942.864918:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723323520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135942.864927:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789135942.865185:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723323776:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865231:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135942.865264:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789135942.865271:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723323648:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865299:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135942.865324:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723324160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865347:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135942.865374:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723323904:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135942.865421:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135942.865425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723324032:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865448:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135942.865476:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324032 00000100:00100000:3.0:1789135942.865481:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324032 00000100:00100000:3.0:1789135942.865527:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789135942.865535:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723324032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.865601:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723324032:12345-0@lo:400:kworker.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135942.865609:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789135942.865650:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723324032:0@lo:400:kworker.0 00000100:00080000:1.0:1789135942.865817:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135942.865822:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135942.865945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323648 00000100:00100000:0.0:1789135942.865951:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323648 00000100:00100000:0.0:1789135942.865992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789135942.866000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723323648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135942.866060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723323648:12345-0@lo:400:kworker.0 Request processed in 61us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135942.866067:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789135942.866105:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323776 00000100:00100000:0.0:1789135942.866109:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323776 00000100:00100000:0.0:1789135942.866134:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324160 00000100:00100000:0.0:1789135942.866138:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324160 00000100:00100000:0.0:1789135942.866160:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723323904 00000100:00100000:0.0:1789135942.866163:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723323904 00000100:00100000:0.0:1789135942.866177:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789135942.866183:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135942.866216:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723323776:12345-0@lo:400:kworker.0 Request processed in 33us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135942.866223:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789135942.866235:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789135942.866240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135942.866267:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723324160:12345-0@lo:400:kworker.0 Request processed in 27us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135942.866273:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789135942.866284:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789135942.866290:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723323904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135942.866317:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723323904:12345-0@lo:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135942.866322:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1789135942.866341:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135942.866366:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0732e0f00 x1876044723323520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135942.866402:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723323520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135942.867651:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723323904:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.867689:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723323648:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.867751:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723324160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135942.867767:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723323776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.374488:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135943.374521:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723324288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135943.374627:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135943.374748:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324288 00000100:00100000:3.0:1789135943.374773:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324288 00000100:00100000:2.0:1789135943.375171:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789135943.375181:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723324288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135943.375231:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135943.375293:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723324288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135943.375302:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789135943.387299:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723324288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135943.503453:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135944.526534:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135945.557511:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135946.317605:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789135946.573341:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135947.597112:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135947.638651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135947.638866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135947.639041:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022144 00000100:00100000:0.0:1789135947.639054:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022144 00000100:00100000:0.0:1789135947.639155:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 142 00000100:00100000:0.0:1789135947.639169:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696022144:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135947.639293:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696022144:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 127us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135947.639303:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 142 00000100:00080000:2.0:1789135947.640190:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135947.646115:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022016 00000100:00100000:1.0:1789135947.646139:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022016 00000100:00100000:1.0:1789135947.646240:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 316 00000100:00100000:1.0:1789135947.646253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696022016:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135947.648085:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696022016:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 1825us (9442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135947.648100:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 316 00000100:00100000:0.0:1789135947.667589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135947.667676:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022272 00000100:00100000:1.0:1789135947.667720:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022272 00000100:00100000:1.0:1789135947.667824:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:1.0:1789135947.667837:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696022272:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:1.0:1789135947.667884:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf961c3 00000100:00080000:1.0:1789135947.667898:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135947.667963:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1789135947.669238:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135947.672296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00010000:00010000:0.0:1789135947.672585:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135947.672748:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+2:2362:x1876044696022272:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 4909us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135947.672765:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789135947.678938:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022400 00000100:00100000:2.0:1789135947.679629:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022400 00000100:00100000:2.0:1789135947.679909:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 143 00000100:00100000:2.0:1789135947.679922:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696022400:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135947.680045:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696022400:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 125us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135947.680053:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 143 00000100:00080000:0.0:1789135947.685995:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135947.981041:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135947.981071:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723324416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135947.981168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135947.983551:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324416 00000100:00100000:2.0:1789135947.983571:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324416 00000100:00080000:3.0:1789135947.983664:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135947.983727:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135947.983741:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723324416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135947.983796:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135947.983921:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723324416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135947.983930:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789135947.984169:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0732e03c0 x1876044723324416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135947.984194:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723324416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135947.984952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723324672:0@lo:400:kworker.0 00000100:00100000:1.0:1789135947.984957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723324928:0@lo:400:kworker.0 00000100:00100000:3.0:1789135947.985026:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723324544:0@lo:400:kworker.0 00000100:00100000:0.0:1789135947.992396:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723324800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135947.992604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135947.992755:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324928 00000100:00100000:1.0:1789135947.992765:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324928 00000100:00100000:1.0:1789135947.992860:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135947.992873:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135947.992946:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723324928:12345-0@lo:400:kworker.0 Request processed in 75us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135947.992955:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789135947.992984:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135947.993590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135947.993654:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324672 00000100:00100000:2.0:1789135947.993659:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324672 00000100:00100000:2.0:1789135947.993721:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789135947.993729:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723324672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135947.993774:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723324672:12345-0@lo:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135947.993781:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789135947.993816:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723324672:0@lo:400:kworker.0 00000100:00100000:0.0:1789135947.996218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135947.996341:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324800 00000100:00100000:2.0:1789135947.996355:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324800 00000100:00100000:2.0:1789135947.996472:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789135947.996483:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723324800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135947.996577:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723324800:12345-0@lo:400:kworker.0 Request processed in 96us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135947.996585:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1789135947.997198:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135947.997253:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723324800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135947.998523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723324928:0@lo:400:kworker.0 00000100:00100000:3.0:1789135947.999091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135947.999165:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723325056:0@lo:400:kworker.0 00000100:00100000:3.0:1789135947.999210:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135947.999531:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325056 00000100:00100000:2.0:1789135947.999541:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325056 00000100:00100000:2.0:1789135947.999626:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135947.999637:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723325056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135947.999750:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723325056:12345-0@lo:400:kworker.0 Request processed in 114us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135947.999758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789135947.999874:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723324544 00000100:00100000:1.0:1789135947.999879:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723324544 00000100:00100000:1.0:1789135947.999921:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789135947.999928:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135947.999968:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723324544:12345-0@lo:400:kworker.0 Request processed in 40us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135947.999974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789135948.000159:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723324544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.000199:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723325056:0@lo:400:kworker.0 00000100:00080000:0.0:1789135948.000626:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135948.493746:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135948.493780:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723325184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135948.493891:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135948.494261:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325184 00000100:00100000:2.0:1789135948.494271:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325184 00000100:00100000:2.0:1789135948.494353:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789135948.494364:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723325184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135948.494418:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135948.494485:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723325184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135948.494493:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135948.495790:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723325184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135948.626745:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135949.645923:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135950.680148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135951.693282:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789135952.656492:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:3.0:1789135952.656501:0:6724:0:(genops.c:885:class_export_put()) final put ffff8b9f463a6800/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:2.0:1789135952.659141:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f463a6800/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0000 00000020:00000080:2.0:1789135952.659210:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f463a5000 for lustre-OST0000 00010000:00010000:1.0:1789135952.717010:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135952.753804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135952.753853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135952.753968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135952.754026:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022528 00000100:00100000:1.0:1789135952.754037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022528 00000100:00100000:1.0:1789135952.754106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 318 00000100:00100000:1.0:1789135952.754116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696022528:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135952.754205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696022528:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 91us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135952.754214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 318 00000100:00100000:2.0:1789135952.754735:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022784 00000100:00100000:2.0:1789135952.754744:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022784 00000100:00080000:0.0:1789135952.754803:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135952.754805:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022656 00000100:00100000:2.0:1789135952.754810:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022656 00000100:00080000:0.0:1789135952.754833:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135952.754843:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 147 00000100:00100000:2.0:1789135952.754852:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696022784:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135952.754862:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 148 00000100:00100000:3.0:1789135952.754872:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696022656:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135952.754926:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696022656:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 56us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135952.754934:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 148 00000100:00100000:2.0:1789135952.754965:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696022784:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 113us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135952.754972:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 147 00000100:00100000:2.0:1789135953.101032:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723325440:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.101187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723325952:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101214:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.101246:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135953.101251:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723325568:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101275:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.101303:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325952 00000100:00100000:2.0:1789135953.101310:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325952 00000100:00100000:2.0:1789135953.101358:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135953.101366:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723325952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101410:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723325952:12345-0@lo:400:kworker.0 Request processed in 45us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.101417:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135953.101436:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325440 00000100:00100000:2.0:1789135953.101439:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325440 00000100:00100000:2.0:1789135953.101459:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325568 00000100:00100000:2.0:1789135953.101462:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325568 00000100:00100000:2.0:1789135953.101481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135953.101487:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723325440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101518:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723325440:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.101524:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135953.101551:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135953.101557:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723325568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101599:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723325568:12345-0@lo:400:kworker.0 Request processed in 42us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.101606:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135953.101638:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723325568:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.101647:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723325440:0@lo:400:kworker.0 00010000:00080000:2.0:1789135953.101657:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f12940 x1876044723325952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135953.101666:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723325952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.101837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723325312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.101868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135953.101898:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723325824:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.101921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135953.101946:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135953.101953:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723325696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.101975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135953.102001:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325696 00000100:00100000:1.0:1789135953.102005:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325696 00000100:00100000:1.0:1789135953.102032:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135953.102038:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723325696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.102074:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723325696:12345-0@lo:400:kworker.0 Request processed in 36us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135953.102080:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135953.102109:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723325696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.102125:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325824 00000100:00100000:1.0:1789135953.102128:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325824 00000100:00100000:2.0:1789135953.102220:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723325312 00000100:00100000:2.0:1789135953.102225:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723325312 00000100:00100000:2.0:1789135953.102250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789135953.102257:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723325312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.102294:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723325312:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.102301:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789135953.102341:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135953.102348:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723325824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.102372:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723325824:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.102377:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789135953.102435:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723325312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135953.102446:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723325824:0@lo:400:kworker.0 00000100:00080000:0.0:1789135953.102735:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135953.102741:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135953.102743:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135953.104792:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723326080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135953.104863:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.104959:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326080 00000100:00100000:2.0:1789135953.104967:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326080 00000100:00100000:2.0:1789135953.105019:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789135953.105040:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723326080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135953.105075:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135953.105129:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723326080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.105136:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789135953.105325:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0732e2580 x1876044723326080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135953.105344:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723326080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135953.614403:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723326208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135953.614476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.614630:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326208 00000100:00100000:2.0:1789135953.614637:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326208 00000100:00100000:2.0:1789135953.614683:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789135953.614691:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723326208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135953.614741:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135953.614784:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723326208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.614790:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135953.615386:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723326208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135953.743267:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135954.766114:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135955.788924:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135956.557438:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789135956.812906:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135957.040972:0:12270:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:12:34 (1789135954) 00010000:00010000:0.0:1789135957.836981:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135957.870609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135957.870657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135957.870689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135957.871035:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696022912 00000100:00100000:3.0:1789135957.871052:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696022912 00000100:00100000:0.0:1789135957.871085:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023168 00000100:00100000:0.0:1789135957.871096:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023168 00000100:00100000:3.0:1789135957.871150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 320 00000100:00100000:3.0:1789135957.871164:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696022912:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135957.871165:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023040 00000100:00100000:0.0:1789135957.871172:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023040 00000100:00100000:0.0:1789135957.871205:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 152 00000100:00100000:0.0:1789135957.871215:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696023168:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135957.871275:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696022912:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 112us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135957.871286:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 320 00000100:00100000:0.0:1789135957.871293:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696023168:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 75us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135957.871304:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 152 00000100:00100000:0.0:1789135957.871326:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 153 00000100:00100000:0.0:1789135957.871335:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696023040:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135957.871363:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696023040:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135957.871370:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 153 00000100:00080000:3.0:1789135957.871391:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135958.221076:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135958.221182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135958.221466:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326336 00000100:00100000:2.0:1789135958.221476:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326336 00000100:00100000:2.0:1789135958.221582:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135958.221594:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723326336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135958.221645:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135958.221757:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723326336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135958.221766:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789135958.221847:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135958.221893:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723326592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.221929:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723326720:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.221965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135958.222029:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723326464:0@lo:400:kworker.0 00000100:00100000:0.0:1789135958.222052:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723326848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.229824:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.230073:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326592 00000100:00100000:3.0:1789135958.230085:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326592 00000100:00100000:3.0:1789135958.230177:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326720 00000100:00100000:3.0:1789135958.230180:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326720 00000100:00100000:3.0:1789135958.230963:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789135958.230984:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723326592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.231103:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723326592:12345-0@lo:400:kworker.0 Request processed in 127us (9138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.231176:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789135958.231189:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723326720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.231376:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723326720:12345-0@lo:400:kworker.0 Request processed in 52us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.231386:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789135958.232060:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789135958.232129:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723326592:0@lo:400:kworker.0 00000100:00080000:3.0:1789135958.232207:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135958.232375:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723326720:0@lo:400:kworker.0 00000100:00100000:2.0:1789135958.234970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135958.235060:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723326976:0@lo:400:kworker.0 00000100:00100000:2.0:1789135958.235116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.235377:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326464 00000100:00100000:1.0:1789135958.235386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326464 00000100:00100000:1.0:1789135958.235454:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789135958.235466:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.235555:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723326464:12345-0@lo:400:kworker.0 Request processed in 91us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.235563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789135958.235729:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326976 00000100:00100000:3.0:1789135958.235734:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326976 00000100:00100000:3.0:1789135958.235780:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789135958.235788:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.235830:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723326976:12345-0@lo:400:kworker.0 Request processed in 43us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.235837:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1789135958.235861:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135958.236603:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723326464:0@lo:400:kworker.0 00000100:00100000:2.0:1789135958.236645:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723326976:0@lo:400:kworker.0 00000100:00100000:0.0:1789135958.236990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135958.237165:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba0732e30c0 x1876044723326336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135958.237197:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135958.241579:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723326848 00000100:00100000:2.0:1789135958.241595:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723326848 00000100:00100000:2.0:1789135958.241695:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789135958.241843:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723326848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135958.241949:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723326848:12345-0@lo:400:kworker.0 Request processed in 112us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135958.241957:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789135958.242055:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723326848:0@lo:400:kworker.0 00000100:00080000:3.0:1789135958.242139:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135958.733573:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723327104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135958.733690:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135958.734047:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723327104 00000100:00100000:0.0:1789135958.734058:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723327104 00000100:00100000:0.0:1789135958.734138:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135958.734153:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723327104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135958.734221:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135958.734291:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723327104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135958.734300:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789135958.736354:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723327104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135958.861063:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135959.027733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135959.027876:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023296 00000100:00100000:3.0:1789135959.027890:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023296 00000100:00100000:3.0:1789135959.027990:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:3.0:1789135959.028023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:10465:x1876044696023296:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135959.028053:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135959.028087:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9628e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff51 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.028166:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.028182:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.028199:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135959.028424:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789135959.028430:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135959.028547:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.028575:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9628e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff51 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135959.028729:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135959.028841:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff51 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.028852:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135959.028855:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135959.028860:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4000, rc 0) 00000100:00100000:3.0:1789135959.029034:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:10465:x1876044696023296:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1015us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135959.029054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:3.0:1789135959.042257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135959.042369:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023424 00000100:00100000:1.0:1789135959.042379:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023424 00000100:00100000:1.0:1789135959.042448:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:1.0:1789135959.042459:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:10466:x1876044696023424:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135959.042487:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135959.042510:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9800/0x38eb79866bf9629c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff58 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042601:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042615:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042628:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042643:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042650:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.042656:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043112:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043123:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043131:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135959.043213:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789135959.043218:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135959.043296:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043317:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043323:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043330:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043336:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135959.043340:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043348:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043360:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:1.0:1789135959.043363:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135959.043368:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043374:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9000/0x38eb79866bf962a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043387:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043393:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043398:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043408:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec9600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135959.043411:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043417:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043425:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ba069d75300) 00010000:00010000:1.0:1789135959.043427:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135959.043429:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043434:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9600/0x38eb79866bf962aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043474:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba044ec9800/0x38eb79866bf9629c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff58 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043489:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff58 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135959.043496:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:1.0:1789135959.043498:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135959.043501:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7800, rc 0) 00000100:00100000:1.0:1789135959.043996:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:10466:x1876044696023424:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1537us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135959.044005:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:0.0:1789135959.050930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135959.051068:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023680 00000100:00100000:3.0:1789135959.051080:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023680 00000100:00100000:3.0:1789135959.051146:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:3.0:1789135959.051156:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:10466:x1876044696023680:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135959.051176:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135959.051769:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf962b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff5f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051851:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051865:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051877:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051915:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051922:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.051929:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.059889:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4e00/0x38eb79866bf962cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.059923:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4e00/0x38eb79866bf962cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.059938:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4e00/0x38eb79866bf962cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135959.059953:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789135959.060192:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060201:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060208:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060213:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135959.060217:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060224:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060237:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:3.0:1789135959.060240:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135959.060245:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060251:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060264:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060276:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060282:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060286:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135959.060289:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060296:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060305:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135959.060308:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135959.060310:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.060316:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.064324:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf962b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff5f expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.064350:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4e00/0x38eb79866bf962cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff5f expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135959.064359:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:3.0:1789135959.064363:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135959.064375:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4e00, rc 0) 00000100:00100000:3.0:1789135959.065410:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10466:x1876044696023680:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 14248us (14485us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789135959.065422:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:2.0:1789135959.071557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135959.071666:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023808 00000100:00100000:3.0:1789135959.071677:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023808 00000100:00100000:3.0:1789135959.071763:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 35 00000100:00100000:3.0:1789135959.071775:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10466:x1876044696023808:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789135959.071895:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10466:x1876044696023808:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135959.071902:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 35 00000040:00080000:2.0:1789135959.631004:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135959.887088:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135960.915108:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135961.198486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.198575:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696023936 00000100:00100000:3.0:1789135961.198585:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696023936 00000100:00100000:3.0:1789135961.198720:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:3.0:1789135961.198732:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10508:x1876044696023936:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135961.198752:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.198772:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf962db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff66 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198836:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198849:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198860:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198888:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198895:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.198900:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789135961.199047:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135961.199148:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199156:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199162:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199168:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.199173:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199180:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199192:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135961.199195:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.199200:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199207:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf962e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199223:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199230:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199236:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199241:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.199244:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199251:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199258:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135961.199261:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.199264:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199270:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf962e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199300:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf962db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff66 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199310:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135961.199312:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.199322:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf962db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff66 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.199332:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789135961.199395:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10508:x1876044696023936:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 666us (919us total) trans 0 rc 301/301 00000100:00100000:3.0:1789135961.199403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:1.0:1789135961.206472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.206570:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024192 00000100:00100000:3.0:1789135961.206580:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024192 00000100:00100000:3.0:1789135961.206958:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:3.0:1789135961.206969:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10508:x1876044696024192:12345-192.168.204.41@tcp:36:lfs.0 00010000:00010000:3.0:1789135961.207027:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135961.207056:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff51 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207072:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135961.207084:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135961.207372:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207386:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207396:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207408:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207415:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.207442:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.208446:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789135961.208461:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208469:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208477:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208482:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.208487:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208495:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208508:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:3.0:1789135961.208511:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.208515:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.208521:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135961.208539:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000076f19333 reply state 00000000a8012c2f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135961.208559:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135961.208691:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:10508:x1876044696024192:12345-192.168.204.41@tcp:36:lfs.0 Request processed in 1721us (2226us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789135961.208720:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00010000:00010000:2.0:1789135961.213650:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213667:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213675:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213681:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135961.213686:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213694:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213757:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ba05c1e9600) 00010000:00010000:2.0:1789135961.213761:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135961.213774:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.213780:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf962f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135961.306674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.307974:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024320 00000100:00100000:3.0:1789135961.307986:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024320 00000100:00100000:3.0:1789135961.308053:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:3.0:1789135961.308063:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:10516:x1876044696024320:12345-192.168.204.41@tcp:101:lctl.0 00010000:00010000:3.0:1789135961.308101:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.308126:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff6d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308192:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308205:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308215:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.308272:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789135961.308277:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135961.308510:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308537:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf962fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff6d expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308568:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff6d expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.308577:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:3.0:1789135961.308580:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135961.308584:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4000, rc 0) 00000100:00100000:3.0:1789135961.308655:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:10516:x1876044696024320:12345-192.168.204.41@tcp:101:lctl.0 Request processed in 593us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.308662:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:1.0:1789135961.378791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.378945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024448 00000100:00100000:3.0:1789135961.378956:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024448 00000100:00100000:3.0:1789135961.379096:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:3.0:1789135961.379108:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:10522:x1876044696024448:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135961.379130:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.379154:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf9630c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff74 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379219:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379235:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379247:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379261:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379483:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379493:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379609:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379619:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379626:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.379658:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789135961.379662:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135961.379748:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379760:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379767:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379774:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379780:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.379785:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379800:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379813:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:3.0:1789135961.379817:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.379822:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379829:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379843:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379850:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379856:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379861:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.379864:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379870:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379877:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135961.379880:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.379883:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379899:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf9631a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379933:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf9630c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff74 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379946:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff74 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.379954:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135961.379956:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789135961.379959:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5e00, rc 0) 00000100:00100000:3.0:1789135961.380018:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:10522:x1876044696024448:12345-192.168.204.41@tcp:101:bash.0 Request processed in 913us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.380027:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:0.0:1789135961.383133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.383217:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024704 00000100:00100000:3.0:1789135961.383227:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024704 00000100:00100000:3.0:1789135961.383291:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:3.0:1789135961.383302:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:10522:x1876044696024704:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135961.383326:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.383348:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96328 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff7b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383513:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383528:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383568:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383634:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383643:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.383650:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135961.384237:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789135961.384398:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384408:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384416:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384464:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384471:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384477:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384482:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.384492:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384500:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384512:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135961.384515:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.384520:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384527:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf9632f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135961.384539:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000efb1ec15 reply state 00000000a60f2ecc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135961.384548:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135961.384576:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96328 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384590:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.384597:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135961.384599:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135961.384602:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135961.384665:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10522:x1876044696024704:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1365us (1551us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789135961.384673:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:1.0:1789135961.392811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00010000:00010000:3.0:1789135961.393924:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393940:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393948:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393954:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135961.393959:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393967:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393985:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135961.393988:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135961.393993:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.393999:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96336 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.397084:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024832 00000100:00100000:2.0:1789135961.397100:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024832 00000100:00100000:2.0:1789135961.397159:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:2.0:1789135961.397169:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1876044696024832:12345-192.168.204.41@tcp:8:bash.0 00010000:00080000:2.0:1789135961.397206:0:6697:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1789135961.397237:0:6697:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf9634b 00002000:00100000:2.0:1789135961.397256:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8b9f478e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135961.397292:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135961.397557:0:6697:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135961.397817:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f478e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135961.397905:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044696024832:12345-192.168.204.41@tcp:8:bash.0 Request processed in 734us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135961.397914:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:1.0:1789135961.402564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135961.405590:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696024960 00000100:00100000:2.0:1789135961.405603:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696024960 00000100:00100000:2.0:1789135961.405686:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:2.0:1789135961.405714:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044696024960:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135961.405731:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135961.405756:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff82 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135961.405802:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135961.405837:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789135961.405842:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135961.405852:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.405872:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.405888:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936e00, rc 0) 00000100:00100000:2.0:1789135961.405950:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:0:x1876044696024960:12345-192.168.204.41@tcp:101:bash.0 Request processed in 255us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135961.405957:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00080000:0.0:1789135961.406039:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135961.414459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135961.414929:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696025088 00000100:00100000:1.0:1789135961.414939:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696025088 00000100:00100000:1.0:1789135961.415005:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:1.0:1789135961.415016:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:10522:x1876044696025088:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:1.0:1789135961.415036:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135961.415058:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff89 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.415090:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.415099:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135961.415103:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135961.415109:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.415156:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.415171:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 8 pid: 6698 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135961.415205:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723327232:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135961.415319:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba04378d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135961.427509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135961.427602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696025216 00000100:00100000:0.0:1789135961.427612:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696025216 00010000:00010000:0.0:1789135961.427656:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 9 pid: 6698 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135961.427724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:0.0:1789135961.427733:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696025216:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135961.427748:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135961.427783:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 9 pid: 6698 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.427798:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 9 pid: 6698 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.427830:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135961.427834:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135961.427842:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.427852:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.427906:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135961.427920:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1876044723327360:192.168.204.41@tcp:105: 00000100:00100000:0.0:1789135961.428002:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34300 going to sleep for 11 seconds 00010000:00010000:2.0:1789135961.428548:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4fdcf8/0x38eb79866bf96352 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff82 expref: 9 pid: 6698 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.428567:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723327232:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135961.428593:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.428604:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6400, rc 0) 00000100:00100000:2.0:1789135961.428636:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:10522:x1876044696025088:12345-192.168.204.41@tcp:101:bash.0 Request processed in 13622us (14188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135961.428644:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:1.0:1789135961.432782:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1876044723327360:192.168.204.41@tcp:105: 00010000:00010000:1.0:1789135961.432810:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135961.432879:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696025216:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 5145us (5379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135961.432894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:2.0:1789135961.440824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.440997:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696025472 00000100:00100000:3.0:1789135961.441010:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696025472 00000100:00100000:3.0:1789135961.441066:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:3.0:1789135961.441076:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10522:x1876044696025472:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:3.0:1789135961.441637:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10522:x1876044696025472:12345-192.168.204.41@tcp:35:bash.0 Request processed in 560us (820us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789135961.441664:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:2.0:1789135961.573914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135961.574214:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696025728 00000100:00100000:0.0:1789135961.574224:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696025728 00000100:00100000:0.0:1789135961.574285:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:0.0:1789135961.574296:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10532:x1876044696025728:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135961.574323:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135961.574348:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff90 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135961.574495:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789135961.574615:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96360 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff90 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.574630:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:0.0:1789135961.574633:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135961.574638:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff90 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.574652:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cd800, rc 0) 00000100:00100000:0.0:1789135961.574813:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10532:x1876044696025728:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 518us (909us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789135961.574820:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:0.0:1789135961.587778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135961.587875:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696025984 00000100:00100000:1.0:1789135961.587885:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696025984 00000100:00100000:1.0:1789135961.587943:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:1.0:1789135961.587953:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10532:x1876044696025984:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135961.588255:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:10532:x1876044696025984:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 302us (487us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789135961.588264:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789135961.670989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.671100:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696026112 00000100:00100000:3.0:1789135961.671110:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696026112 00000100:00100000:3.0:1789135961.671172:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:3.0:1789135961.671184:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:10538:x1876044696026112:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135961.671211:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.671232:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf9636e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff97 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671294:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671307:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671317:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.671373:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789135961.671376:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135961.671422:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671449:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf9636e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff97 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671467:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff97 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.671489:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135961.671492:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135961.671496:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5a00, rc 0) 00000100:00100000:3.0:1789135961.671632:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:10538:x1876044696026112:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 449us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.671639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:2.0:1789135961.690157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.690243:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696026368 00000100:00100000:3.0:1789135961.690256:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696026368 00000100:00100000:3.0:1789135961.690341:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:3.0:1789135961.690354:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:10538:x1876044696026368:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135961.690382:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.690410:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf9637c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ff9e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.690593:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.690611:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.690627:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.690639:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135961.691262:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf9637c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff9e expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.691301:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff9e expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.691311:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135961.691315:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135961.691319:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135961.691409:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10538:x1876044696026368:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1057us (1266us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789135961.691429:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:0.0:1789135961.705968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135961.706090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135961.709111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696026752 00000100:00100000:2.0:1789135961.709134:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696026752 00000100:00100000:2.0:1789135961.709246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:2.0:1789135961.709259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:2363:x1876044696026752:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135961.709281:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135961.709313:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff9e expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.709337:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:2.0:1789135961.709344:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135961.709444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696026752:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 188us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135961.709453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789135961.713586:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696026624 00000100:00100000:3.0:1789135961.713610:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696026624 00000100:00100000:3.0:1789135961.713692:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:3.0:1789135961.713835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10538:x1876044696026624:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135961.713869:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.713899:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffa5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.714030:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.714049:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.714064:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135961.714080:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135961.714278:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffa5 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.714301:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffa5 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.714310:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135961.714314:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789135961.714317:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135961.714506:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10538:x1876044696026624:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 803us (8555us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789135961.714526:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:0.0:1789135961.730213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135961.730615:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696026880 00000100:00100000:2.0:1789135961.730629:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696026880 00000100:00100000:2.0:1789135961.730755:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:2.0:1789135961.730768:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696026880:12345-192.168.204.41@tcp:1:lfs.0 00010000:00010000:2.0:1789135961.730834:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.730861:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.730871:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135961.730877:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135961.730882:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.730951:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.730968:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.730988:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8442:1876044723327488:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135961.731132:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135961.733624:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8442:1876044723327488:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135961.733666:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135961.734534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135961.734835:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027008 00000100:00100000:1.0:1789135961.734846:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027008 00002000:00100000:1.0:1789135961.734913:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ba085f13c00 x1876044696027008/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:392/0 lens 504/0 e 0 to 0 dl 1789135972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135961.734927:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f13c00 with x1876044696027008 ext(0->12) 00010000:00010000:1.0:1789135961.734937:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 8 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.734956:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 8 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135961.734983:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba085f13c00 00000100:00100000:1.0:1789135961.735029:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789135961.735040:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696027008:12345-192.168.204.41@tcp:4:lfs.0 00000001:00100000:3.0:1789135961.833602:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000100:00100000:1.0:1789135961.883886:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696027008:12345-192.168.204.41@tcp:4:lfs.0 Request processed in 148836us (149350us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789135961.883912:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00002000:00100000:1.0:1789135961.883925:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ba085f13c00 x1876044696027008/t4294967299(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:392/0 lens 504/448 e 0 to 0 dl 1789135972 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135961.883934:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f13c00 with x1876044696027008 ext(0->12) 00010000:00010000:1.0:1789135961.883945:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 9 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.883961:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 9 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135961.883969:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba085f13c00 00000001:00080000:0.0:1789135961.884240:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789135961.889792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.889922:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027136 00000100:00100000:3.0:1789135961.889933:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027136 00010000:00010000:3.0:1789135961.889972:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135961.890018:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:3.0:1789135961.890028:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2365:x1876044696027136:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135961.890044:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789135961.890064:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789135961.890084:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789135960 00002000:00010000:3.0:1789135961.890086:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789135960 00002000:00010000:3.0:1789135961.890088:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789135960 00002000:00010000:3.0:1789135961.890090:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789135961.890097:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.890111:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.890138:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf96359 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff89 expref: 7 pid: 6700 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.890155:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135961.890159:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135961.890165:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.890174:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.890211:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135961.890270:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696027136:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 242us (486us total) trans 0 rc 0/0 00010000:00010000:2.0:1789135961.890272:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135961.890282:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 41 00010000:00010000:2.0:1789135961.890288:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890316:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890325:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890334:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890353:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135961.890365:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890379:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890391:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.890399:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6f1eae/0x38eb79866bf963a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.890460:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696026880:12345-192.168.204.41@tcp:1:lfs.0 Request processed in 159695us (160263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135961.890468:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:2.0:1789135961.893326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135961.893647:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027392 00000100:00100000:1.0:1789135961.893657:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027392 00000100:00100000:1.0:1789135961.893802:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789135961.893814:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10538:x1876044696027392:12345-192.168.204.41@tcp:35:lfs.0 00000004:00010000:1.0:1789135961.893878:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffa5 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135961.894188:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1789135961.894239:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789135961.896147:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789135961.896235:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.896256:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.896266:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.896304:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.896320:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 24 pid: 5850 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135961.896336:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723327616:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135961.896466:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135961.901129:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723327616:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135961.901170:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.902809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.902897:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027520 00000100:00100000:3.0:1789135961.902905:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027520 00010000:00010000:2.0:1789135961.903201:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 25 pid: 5850 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135961.903240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:2.0:1789135961.903251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:2364:x1876044696027520:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135961.903267:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135961.903274:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 25 pid: 5850 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903310:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 25 pid: 5850 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903347:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9633d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff7b expref: 25 pid: 5850 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903364:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:2.0:1789135961.903370:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903378:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903385:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135961.903425:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135961.903588:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.903597:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135961.903744:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789135961.903961:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789135961.904085:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723327744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135961.904140:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135961.904182:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0446ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135961.904316:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723327744 00000100:00100000:0.0:1789135961.904323:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723327744 00000100:00100000:0.0:1789135961.904388:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135961.904397:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723327744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135961.904481:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723327744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135961.904487:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135961.904538:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723327744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789135961.905127:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789135961.905183:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723327872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135961.905213:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135961.905229:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135961.905242:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723327872 00000100:00100000:0.0:1789135961.905246:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723327872 00000100:00100000:0.0:1789135961.905269:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135961.905276:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723327872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135961.905485:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1876044723327872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 208us (270us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789135961.905492:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135961.905531:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723327872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789135961.905566:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:2364:x1876044696027520:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2314us (2761us total) trans 0 rc 0/0 00000001:00080000:0.0:1789135961.905570:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789135961.905576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 42 00010000:00010000:0.0:1789135961.905600:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905610:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905617:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905623:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135961.905628:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905636:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905659:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:0.0:1789135961.905662:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789135961.905667:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135961.905673:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf963ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135961.905852:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789135961.906052:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789135961.906063:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435780362488ns, next at 436780360393ns, rc = 0 00000001:00080000:0.0:1789135961.906070:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789135961.906100:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:0.0:1789135961.906104:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135961.906109:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96398 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffa5 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135961.906189:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10538:x1876044696027392:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 12378us (12872us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789135961.906197:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000020:00080000:0.0:1789135961.906201:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1789135961.906542:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135961.910202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.910308:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027648 00000100:00100000:3.0:1789135961.910337:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027648 00000100:00100000:3.0:1789135961.910428:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:3.0:1789135961.910441:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10538:x1876044696027648:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135961.910473:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135961.910506:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf963b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffac expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.910598:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf963b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffac expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.910628:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf963b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffac expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135961.910651:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135961.910655:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135961.910660:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789135961.910782:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:10538:x1876044696027648:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 342us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.910790:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:2.0:1789135961.916391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135961.916514:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696027904 00000100:00100000:3.0:1789135961.916524:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696027904 00000100:00100000:3.0:1789135961.916589:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:3.0:1789135961.916600:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:10538:x1876044696027904:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135961.916889:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10538:x1876044696027904:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 290us (509us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789135961.916898:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00010000:00010000:3.0:1789135961.934951:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135962.007147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135962.008988:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696028160 00000100:00100000:0.0:1789135962.009005:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696028160 00000100:00100000:0.0:1789135962.009100:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:0.0:1789135962.009110:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10548:x1876044696028160:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135962.009136:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135962.009176:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf963bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffb3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135962.009290:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789135962.009400:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf963bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffb3 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.009425:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:0.0:1789135962.009427:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135962.009433:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf963bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffb3 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.009447:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc800, rc 0) 00000100:00100000:0.0:1789135962.009517:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10548:x1876044696028160:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 408us (2399us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789135962.009524:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:1.0:1789135962.015775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.016088:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696028288 00000100:00100000:3.0:1789135962.016099:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696028288 00000100:00100000:3.0:1789135962.016161:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:3.0:1789135962.016171:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10548:x1876044696028288:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:3.0:1789135962.016260:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016276:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016287:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016301:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016308:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016315:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016420:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016429:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016435:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135962.016476:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016512:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016518:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016525:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016541:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.016545:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016552:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016565:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135962.016568:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.016573:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016580:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016592:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016598:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016603:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016615:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.016617:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016624:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016631:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135962.016634:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.016636:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016641:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016655:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016662:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016667:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016671:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.016674:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016679:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016696:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.016975:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.016982:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.016988:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.017084:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10548:x1876044696028288:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 913us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135962.017093:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:0.0:1789135962.019094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.019227:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696028544 00000100:00100000:3.0:1789135962.019236:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696028544 00000100:00100000:3.0:1789135962.019286:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:3.0:1789135962.019295:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10548:x1876044696028544:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135962.019565:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10548:x1876044696028544:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 269us (479us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789135962.019573:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:0.0:1789135962.053908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.054014:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696028800 00000100:00100000:3.0:1789135962.054026:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696028800 00000100:00100000:3.0:1789135962.054102:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:3.0:1789135962.054115:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10551:x1876044696028800:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135962.054159:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135962.054185:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054283:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054317:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054331:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054348:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054355:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054361:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054539:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054547:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054554:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135962.054565:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135962.054690:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054756:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054766:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054781:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.054786:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054795:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054810:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135962.054814:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.054819:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054827:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf963e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054842:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054848:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054854:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054859:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.054862:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054867:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054884:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135962.054887:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.054889:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054896:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf963ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054945:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf963de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054958:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.054965:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.054968:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135962.054970:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135962.055050:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10551:x1876044696028800:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 939us (1159us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789135962.055059:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:1.0:1789135962.058565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.058673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696028928 00000100:00100000:3.0:1789135962.058685:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696028928 00000100:00100000:3.0:1789135962.058789:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:3.0:1789135962.058800:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10551:x1876044696028928:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135962.058892:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.058913:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.058948:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.058987:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.058994:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.059002:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.059009:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.059014:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.059022:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.059038:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.059042:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135962.059048:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.059055:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.059170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10551:x1876044696028928:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 370us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135962.059179:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:0.0:1789135962.063391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135962.063970:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696029184 00000100:00100000:2.0:1789135962.063983:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696029184 00000100:00100000:2.0:1789135962.064094:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:2.0:1789135962.064107:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10551:x1876044696029184:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:2.0:1789135962.064440:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:10551:x1876044696029184:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 334us (1064us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789135962.064465:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:2.0:1789135962.298668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.298883:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696029440 00000100:00100000:3.0:1789135962.299010:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696029440 00000100:00100000:3.0:1789135962.299065:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789135962.299075:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:10582:x1876044696029440:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:3.0:1789135962.299100:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135962.299121:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffc1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.299370:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9640f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.299384:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9640f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.299397:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9640f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135962.299418:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135962.299770:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc1 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.299790:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9640f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc1 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.299799:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.299802:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135962.299805:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:3.0:1789135962.300004:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10582:x1876044696029440:12345-192.168.204.41@tcp:101:cat.0 Request processed in 929us (1345us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789135962.300012:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:1.0:1789135962.322194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.323522:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696029568 00000100:00100000:3.0:1789135962.323535:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696029568 00000100:00100000:3.0:1789135962.323609:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:3.0:1789135962.323619:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:2363:x1876044696029568:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135962.323634:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135962.323659:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9640f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc1 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.323678:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.323683:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135962.323787:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:2363:x1876044696029568:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 169us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135962.323796:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:2.0:1789135962.324025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.324430:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696029824 00000100:00100000:3.0:1789135962.324435:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696029824 00000100:00100000:3.0:1789135962.324471:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789135962.324478:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:10582:x1876044696029824:12345-192.168.204.41@tcp:35:cat.0 00000100:00100000:3.0:1789135962.324817:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10582:x1876044696029824:12345-192.168.204.41@tcp:35:cat.0 Request processed in 337us (791us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789135962.324825:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:2.0:1789135962.386143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.386242:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030080 00000100:00100000:3.0:1789135962.386253:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030080 00000100:00100000:3.0:1789135962.386314:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:3.0:1789135962.386325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10588:x1876044696030080:12345-192.168.204.41@tcp:101:dd.0 00010000:00010000:3.0:1789135962.386350:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135962.386353:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135962.386394:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff97 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386425:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135962.386430:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135962.386445:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9641d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffc8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386780:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386796:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386805:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386839:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.386853:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 36 pid: 5851 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.386868:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723328000:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135962.387132:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca6f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135962.400314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135962.400494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030208 00000100:00100000:0.0:1789135962.400505:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030208 00010000:00010000:0.0:1789135962.400565:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 37 pid: 5851 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135962.400608:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:0.0:1789135962.400618:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:2364:x1876044696030208:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135962.400634:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135962.400641:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 37 pid: 5851 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.400667:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 37 pid: 5851 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.400692:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:0.0:1789135962.400697:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.400745:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.400754:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.400776:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135962.400838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:2364:x1876044696030208:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 221us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135962.400845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 43 00010000:00010000:3.0:1789135962.401917:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf963f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffba expref: 36 pid: 5851 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.401940:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723328000:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135962.401976:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.401986:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.401992:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135962.402013:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135962.402210:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9641d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.402227:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.402236:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.402239:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789135962.402242:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135962.402297:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10588:x1876044696030080:12345-192.168.204.41@tcp:101:dd.0 Request processed in 15974us (16166us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789135962.402305:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:1.0:1789135962.415536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135962.415643:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030464 00000100:00100000:2.0:1789135962.415653:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030464 00000100:00100000:2.0:1789135962.415747:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 52 00000100:00100000:2.0:1789135962.415757:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10588:x1876044696030464:12345-192.168.204.41@tcp:36:dd.0 00010000:00010000:2.0:1789135962.416032:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135962.416052:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135962.416064:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135962.416112:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789135962.416133:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005def6c83 reply state 0000000066876b9c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135962.416141:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135962.416303:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:10588:x1876044696030464:12345-192.168.204.41@tcp:36:dd.0 Request processed in 547us (786us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789135962.416311:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 52 00000020:00080000:2.0:1789135962.416317:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135962.419375:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419392:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419411:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419436:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.419441:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419449:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419468:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.419471:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.419476:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.419482:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135962.725470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135962.725959:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030592 00000100:00100000:0.0:1789135962.725970:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030592 00000100:00100000:0.0:1789135962.726035:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:0.0:1789135962.726045:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:10602:x1876044696030592:12345-192.168.204.41@tcp:101:stat.0 00010000:00010000:0.0:1789135962.726072:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135962.726097:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffcf expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726848:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726886:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726897:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726916:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726924:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.726930:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.727029:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.727041:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.727049:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.727085:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.727100:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 39 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135962.728301:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723328128:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135962.728442:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0429d2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135962.733097:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723328128:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135962.733132:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135962.733976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.734071:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030848 00000100:00100000:3.0:1789135962.734079:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030848 00000100:00100000:3.0:1789135962.734151:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:3.0:1789135962.734162:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:5607:x1876044696030848:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789135962.734530:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:5607:x1876044696030848:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 369us (558us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789135962.734539:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789135962.743254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.743380:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696030976 00000100:00100000:3.0:1789135962.743390:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696030976 00010000:00010000:3.0:1789135962.743447:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.743503:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:3.0:1789135962.743538:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059226850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:2364:x1876044696030976:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135962.743554:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135962.743561:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.743575:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.743598:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96424 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffc8 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.744008:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.744016:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.744026:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.744034:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.744077:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135962.744149:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059226850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:2364:x1876044696030976:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 612us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135962.744157:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 44 00010000:00010000:0.0:1789135962.746044:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746060:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135962.746123:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789135962.746127:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135962.746177:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746191:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746201:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746208:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746214:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746221:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cd800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135962.746238:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746247:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746263:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789135962.746266:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135962.746270:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746277:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746293:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746299:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746305:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746310:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135962.746313:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746319:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746327:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135962.746329:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135962.746340:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746346:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746390:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffcf expref: 40 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746419:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffcf expref: 39 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.746427:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:0.0:1789135962.746429:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135962.746432:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030800, rc 0) 00000100:00100000:0.0:1789135962.746505:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:10602:x1876044696030592:12345-192.168.204.41@tcp:101:stat.0 Request processed in 20461us (21044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135962.747244:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:2.0:1789135962.865883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135962.865977:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696031232 00000100:00100000:3.0:1789135962.865987:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696031232 00000100:00100000:3.0:1789135962.866037:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:3.0:1789135962.866047:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:10608:x1876044696031232:12345-192.168.204.41@tcp:36:truncate.0 00010000:00010000:3.0:1789135962.866120:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135962.866148:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9644e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffcf expref: 39 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.866165:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.866170:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135962.867051:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.867067:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.867077:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135962.867134:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789135962.867164:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ab6968db reply state 0000000078a5dbbb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135962.867173:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135962.867296:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:10608:x1876044696031232:12345-192.168.204.41@tcp:36:truncate.0 Request processed in 1248us (1422us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789135962.867304:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 54 00000020:00080000:3.0:1789135962.867310:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135962.873424:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873439:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873447:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873465:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135962.873470:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873477:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873494:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135962.873497:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135962.873502:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135962.873508:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96455 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135962.915456:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000004:00080000:3.0:1789135962.915476:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789135962.915516:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba0446b6840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789135962.915522:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072603800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba044a7dc00 00000020:00080000:3.0:1789135962.915525:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072603b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba0604f0000 00000001:00080000:3.0:1789135962.915556:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:3.0:1789135962.915566:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000020:00080000:2.0:1789135962.915763:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789135962.915885:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789135962.916214:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135962.916236:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723328256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789135962.916304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135962.916525:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328256 00000100:00100000:1.0:1789135962.916533:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328256 00000100:00100000:1.0:1789135962.916585:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135962.916595:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044723328256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789135962.916621:0:6697:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789135962.916653:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa40c58, atime: 0x6aa40c58, ctime: 0x6aa40c58, blocks: 0xb 00010000:00010000:1.0:1789135962.916662:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135962.916677:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1789135962.916682:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135962.916688:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135962.916887:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135962.916963:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135962.916971:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135962.917034:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135962.920636:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723328256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4035us (4324us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789135962.920649:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1789135962.922388:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba073f76940/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789135962.922414:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723328256:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789135962.927037:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135962.927053:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.927066:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135962.927071:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.927083:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.927130:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.927137:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf9645c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135962.927167:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135962.927169:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135962.927171:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135962.956921:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135962.992607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135962.992655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135962.992688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135962.992814:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696031488 00000100:00100000:1.0:1789135962.992824:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696031488 00000100:00100000:1.0:1789135962.992885:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:1.0:1789135962.992911:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696031488:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135962.992989:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2366:x1876044696031488:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135962.992998:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:0.0:1789135962.993267:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696031616 00000100:00100000:0.0:1789135962.993272:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696031616 00000100:00100000:0.0:1789135962.993319:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 157 00000100:00100000:0.0:1789135962.993327:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696031616:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135962.993363:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2366:x1876044696031616:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 36us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135962.993370:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 157 00000100:00080000:1.0:1789135962.993638:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135962.994175:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696031360 00000100:00100000:3.0:1789135962.994181:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696031360 00000100:00100000:3.0:1789135962.994263:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 322 00000100:00100000:3.0:1789135962.994271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696031360:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135962.994366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696031360:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 94us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135962.994373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 322 00000100:00100000:1.0:1789135963.112686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135963.113198:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696031744 00000100:00100000:3.0:1789135963.113208:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696031744 00000100:00100000:3.0:1789135963.113286:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:3.0:1789135963.113297:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:10622:x1876044696031744:12345-192.168.204.41@tcp:101:stat.0 00010000:00010000:3.0:1789135963.113322:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.113344:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffd6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113419:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113433:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113444:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113460:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113468:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.113494:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114218:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114230:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114240:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135963.114279:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789135963.114284:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135963.114310:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114323:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114332:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114339:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114346:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114352:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135963.114356:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114371:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114383:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135963.114399:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.114405:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114412:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9646a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114425:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114431:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114437:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114442:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135963.114444:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114450:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114458:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9b00) 00010000:00010000:3.0:1789135963.114460:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.114463:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.114483:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789135963.116114:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135963.116203:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.116229:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.116237:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135963.116240:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135963.116243:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5a00, rc 0) 00000100:00100000:3.0:1789135963.116322:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10622:x1876044696031744:12345-192.168.204.41@tcp:101:stat.0 Request processed in 3026us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135963.116332:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:3.0:1789135963.283686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.284269:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696032000 00000100:00100000:0.0:1789135963.284280:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696032000 00000100:00100000:0.0:1789135963.284485:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00100000:0.0:1789135963.284496:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10632:x1876044696032000:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135963.284518:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135963.284538:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9647f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffdd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135963.284820:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789135963.284999:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9647f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffdd expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.285013:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:0.0:1789135963.285017:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135963.285022:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9647f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffdd expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.285036:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135963.285115:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10632:x1876044696032000:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 621us (1438us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789135963.285123:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00100000:1.0:1789135963.292375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135963.294626:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696032256 00000100:00100000:3.0:1789135963.294644:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696032256 00000100:00100000:3.0:1789135963.294787:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:3.0:1789135963.294797:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10632:x1876044696032256:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135963.295277:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10632:x1876044696032256:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 480us (2910us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789135963.295286:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789135963.341276:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723328512:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.341370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135963.341442:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723329024:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.341471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135963.341500:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135963.341518:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723328640:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.341540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135963.341572:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328512 00000100:00100000:0.0:1789135963.341579:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328512 00000100:00100000:0.0:1789135963.341621:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328640 00000100:00100000:0.0:1789135963.341624:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328640 00000100:00100000:0.0:1789135963.341654:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789135963.341662:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723328512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.341938:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723328512:12345-0@lo:400:kworker.0 Request processed in 276us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.341955:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789135963.341974:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135963.341981:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723328640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.342011:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723328640:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.342018:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135963.342038:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723329024 00000100:00100000:0.0:1789135963.342041:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723329024 00000100:00100000:0.0:1789135963.342065:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135963.342072:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723329024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.342103:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723329024:12345-0@lo:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.342109:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135963.342150:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723328640:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.342161:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723328512:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.342171:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723329024:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.342657:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723328768:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.342748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135963.342778:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789135963.342785:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723328384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.342811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135963.342833:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723328896:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.342856:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135963.342880:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328384 00000100:00100000:1.0:1789135963.342884:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328384 00000100:00100000:1.0:1789135963.342911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789135963.342918:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723328384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.342951:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723328384:12345-0@lo:400:kworker.0 Request processed in 33us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.342957:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1789135963.342980:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135963.342986:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135963.342994:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328896 00000100:00100000:1.0:1789135963.342997:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328896 00000100:00100000:1.0:1789135963.343022:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789135963.343029:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723328896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.343058:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723328896:12345-0@lo:400:kworker.0 Request processed in 30us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.343064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1789135963.343079:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135963.343098:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723328384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.343108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723328896:0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.343134:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723328768 00000100:00100000:1.0:1789135963.343145:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723328768 00000100:00100000:1.0:1789135963.343173:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135963.343179:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723328768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135963.343211:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723328768:12345-0@lo:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.343217:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789135963.343230:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135963.343244:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723328768:0@lo:400:kworker.0 00000100:00100000:0.0:1789135963.345635:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0412a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723329152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135963.345755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135963.346368:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723329152 00000100:00100000:2.0:1789135963.346377:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723329152 00000100:00100000:2.0:1789135963.346443:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135963.346451:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876044723329152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135963.346500:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135963.346574:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876044723329152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.346581:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135963.349164:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0412a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723329152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135963.402528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.402638:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696032512 00000100:00100000:0.0:1789135963.402647:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696032512 00000100:00100000:0.0:1789135963.402750:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:0.0:1789135963.402768:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10638:x1876044696032512:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:0.0:1789135963.402794:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135963.402816:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9648d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.402939:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.402954:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.402962:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.402995:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.403010:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 16 pid: 5850 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135963.403024:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723329280:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135963.403101:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135963.408796:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723329280:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135963.408826:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135963.409152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.409239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696032640 00000100:00100000:0.0:1789135963.409248:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696032640 00010000:00010000:0.0:1789135963.409294:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 17 pid: 5850 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135963.409337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789135963.409347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:2364:x1876044696032640:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135963.409368:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135963.409375:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 17 pid: 5850 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409413:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 17 pid: 5850 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409437:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffd6 expref: 17 pid: 5850 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409453:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:0.0:1789135963.409458:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409468:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409477:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.409508:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135963.409574:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2364:x1876044696032640:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 228us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.409582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00010000:00010000:3.0:1789135963.410223:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.410244:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135963.410271:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789135963.410444:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9648d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.410460:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.410469:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135963.410472:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789135963.410475:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030400, rc 0) 00000100:00100000:3.0:1789135963.410540:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:10638:x1876044696032512:12345-192.168.204.41@tcp:101:bash.0 Request processed in 7782us (8023us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789135963.410549:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:1.0:1789135963.413058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.413144:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696032896 00000100:00100000:0.0:1789135963.413153:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696032896 00000100:00100000:0.0:1789135963.413212:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 58 00000100:00100000:0.0:1789135963.413221:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:10638:x1876044696032896:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:0.0:1789135963.413511:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.413534:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.413552:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135963.413897:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789135963.413928:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000e0ee282 reply state 000000007d78de39 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135963.413938:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135963.414673:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10638:x1876044696032896:12345-192.168.204.41@tcp:36:bash.0 Request processed in 1443us (1614us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789135963.414682:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 58 00000020:00080000:0.0:1789135963.414688:0:5851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135963.416460:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416476:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416482:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416504:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135963.416509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416536:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416553:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135963.416556:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.416561:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.416568:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf964a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135963.420642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135963.420749:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696033024 00000100:00100000:3.0:1789135963.420761:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696033024 00000100:00100000:3.0:1789135963.420824:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:3.0:1789135963.420835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10638:x1876044696033024:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135963.420859:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.420881:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf964a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62ffeb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.420986:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.421000:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.421009:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.421044:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.421064:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135963.421078:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723329408:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135963.421180:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135963.428025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135963.428130:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696033152 00000100:00100000:2.0:1789135963.428139:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696033152 00010000:00010000:2.0:1789135963.428179:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 20 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135963.428222:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:2.0:1789135963.428233:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:2363:x1876044696033152:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135963.428247:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135963.428254:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 20 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.428284:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 20 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.428306:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135963.428312:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.428321:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.428328:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.428346:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135963.428414:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:2363:x1876044696033152:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 182us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.428422:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 46 00010000:00010000:3.0:1789135963.428680:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96494 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffe4 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135963.428742:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723329408:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135963.428764:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.428773:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.428779:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135963.428829:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789135963.428833:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135963.428854:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.428887:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf964a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffeb expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.428901:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffeb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.428917:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135963.428920:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135963.428923:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135963.428951:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10638:x1876044696033024:12345-192.168.204.41@tcp:101:bash.0 Request processed in 8119us (8321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135963.428958:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:1.0:1789135963.432263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135963.432340:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696033408 00000100:00100000:3.0:1789135963.432349:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696033408 00000100:00100000:3.0:1789135963.432414:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:3.0:1789135963.432423:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10638:x1876044696033408:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:3.0:1789135963.432668:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10638:x1876044696033408:12345-192.168.204.41@tcp:35:bash.0 Request processed in 246us (414us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789135963.432677:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:0.0:1789135963.532959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.533070:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696033664 00000100:00100000:1.0:1789135963.533081:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696033664 00000100:00100000:1.0:1789135963.533164:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:1.0:1789135963.533175:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10648:x1876044696033664:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135963.533200:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135963.533222:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf964b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fff2 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135963.533524:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789135963.533694:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf964b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fff2 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.533741:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135963.533744:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135963.533758:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf964b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fff2 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.533771:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789135963.533839:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10648:x1876044696033664:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 665us (892us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1789135963.533846:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:0.0:1789135963.537313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135963.537367:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696033792 00000100:00100000:2.0:1789135963.537386:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696033792 00000100:00100000:2.0:1789135963.537448:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:2.0:1789135963.537460:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10648:x1876044696033792:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:2.0:1789135963.537560:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.537577:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.537589:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.537631:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.537639:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.537645:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.538451:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.538462:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.538470:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135963.543636:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543661:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543684:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543693:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543713:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135963.543718:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543744:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543892:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135963.543897:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135963.543903:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543910:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf964c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543929:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543935:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543940:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543945:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135963.543947:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543952:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543959:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2e00) 00010000:00010000:2.0:1789135963.543962:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135963.543964:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543980:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf964cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.543999:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544004:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544010:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544015:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135963.544018:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544024:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544033:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135963.544035:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135963.544039:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.544048:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf964d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135963.544148:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10648:x1876044696033792:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 6685us (6842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.544159:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:3.0:1789135963.549092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135963.549201:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696034048 00000100:00100000:2.0:1789135963.549213:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696034048 00000100:00100000:3.0:1789135963.550724:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:3.0:1789135963.550738:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10648:x1876044696034048:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135963.551266:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10648:x1876044696034048:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 528us (2181us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789135963.551275:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:0.0:1789135963.615586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.615925:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696034304 00000100:00100000:1.0:1789135963.615936:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696034304 00000100:00100000:1.0:1789135963.615998:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:1.0:1789135963.616008:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10651:x1876044696034304:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135963.616032:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135963.616055:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf964da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a62fff9 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616133:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616147:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616159:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616175:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616181:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616186:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616578:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf964ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616588:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf964ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616596:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf964ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135963.616605:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789135963.616745:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616753:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616774:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616779:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135963.616784:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616791:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616804:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135963.616807:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135963.616811:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616827:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf964e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616841:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616847:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616853:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616858:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135963.616862:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616869:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616876:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba069d75e00) 00010000:00010000:1.0:1789135963.616879:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135963.616881:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616886:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf964e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616927:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf964da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fff9 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616941:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf964ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fff9 expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.616954:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135963.616956:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135963.616958:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7600, rc 0) 00000100:00100000:1.0:1789135963.617037:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10651:x1876044696034304:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1030us (1461us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789135963.617046:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:0.0:1789135963.625374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.625571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.625639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696034560 00000100:00100000:1.0:1789135963.625648:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696034560 00000100:00100000:1.0:1789135963.625727:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:1.0:1789135963.625737:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10651:x1876044696034560:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:1.0:1789135963.625822:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625839:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625852:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625879:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625886:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625892:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625898:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135963.625917:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625925:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625938:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135963.625941:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135963.625945:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.625951:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf964fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135963.626019:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10651:x1876044696034560:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 283us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.626027:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:2.0:1789135963.627052:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696034432 00000100:00100000:2.0:1789135963.627061:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696034432 00000100:00100000:2.0:1789135963.627154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:2.0:1789135963.627164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2365:x1876044696034432:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135963.627177:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135963.627197:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf964ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fff9 expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.627211:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135963.627215:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135963.627259:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:2365:x1876044696034432:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 97us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.627266:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:0.0:1789135963.632611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.633230:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696034816 00000100:00100000:1.0:1789135963.633241:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696034816 00000100:00100000:1.0:1789135963.633355:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:1.0:1789135963.633366:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:10651:x1876044696034816:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135963.633634:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10651:x1876044696034816:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 269us (1032us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789135963.633643:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:3.0:1789135963.817349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.817969:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035072 00000100:00100000:1.0:1789135963.817979:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035072 00000100:00100000:1.0:1789135963.818110:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00100000:1.0:1789135963.818317:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10669:x1876044696035072:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:1.0:1789135963.818347:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135963.818395:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96504 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630000 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.818522:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf9650b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.818536:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf9650b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.818548:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf9650b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135963.818559:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789135963.818696:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96504 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630000 expref: 26 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.818744:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf9650b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630000 expref: 25 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.818753:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135963.818756:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789135963.818759:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789135963.818830:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10669:x1876044696035072:12345-192.168.204.41@tcp:101:cat.0 Request processed in 711us (1492us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789135963.818838:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00100000:2.0:1789135963.849141:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.849307:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035200 00000100:00100000:1.0:1789135963.849317:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035200 00000100:00100000:1.0:1789135963.849389:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:1.0:1789135963.849400:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10670:x1876044696035200:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135963.849440:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135963.849462:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630007 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849536:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849550:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849561:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135963.849770:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789135963.849774:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135963.849852:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849881:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630007 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849899:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630007 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.849907:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135963.849910:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135963.849914:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7e00, rc 0) 00000100:00100000:1.0:1789135963.849981:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10670:x1876044696035200:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 584us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.849988:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:3.0:1789135963.852982:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135963.853005:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0412aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723329536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135963.853078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135963.853266:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723329536 00000100:00100000:2.0:1789135963.853274:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723329536 00000100:00100000:2.0:1789135963.853330:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135963.853340:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723329536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135963.853387:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135963.853439:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723329536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.853447:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789135963.853736:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0412aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723329536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135963.860994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.861115:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035584 00000100:00100000:0.0:1789135963.861134:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035584 00000100:00100000:0.0:1789135963.861194:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:0.0:1789135963.861204:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10670:x1876044696035584:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:0.0:1789135963.861554:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10670:x1876044696035584:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 350us (569us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789135963.861562:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:3.0:1789135963.864555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135963.864659:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035712 00000100:00100000:2.0:1789135963.864668:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035712 00000100:00100000:2.0:1789135963.864777:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:2.0:1789135963.864787:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10670:x1876044696035712:12345-192.168.204.41@tcp:103:lfs.0 00010000:00010000:2.0:1789135963.864815:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789135963.864842:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf964b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffeb expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.864863:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf9650b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630000 expref: 26 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.864874:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf963b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ffac expref: 25 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135963.864883:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135963.864894:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135963.864946:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10670:x1876044696035712:12345-192.168.204.41@tcp:103:lfs.0 Request processed in 160us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135963.864954:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:2.0:1789135963.874013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135963.874086:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035840 00000100:00100000:0.0:1789135963.874132:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035840 00000100:00100000:0.0:1789135963.874184:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:0.0:1789135963.874194:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10670:x1876044696035840:12345-192.168.204.41@tcp:58:lfs.0 00010000:00010000:0.0:1789135963.874313:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.874329:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.874342:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135963.875055:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135963.875256:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789135963.875318:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789135963.875435:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10670:x1876044696035840:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 1239us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.875444:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:3.0:1789135963.923696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135963.924777:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696035968 00000100:00100000:1.0:1789135963.924790:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696035968 00000100:00100000:1.0:1789135963.924910:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:1.0:1789135963.924921:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10672:x1876044696035968:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135963.924941:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135963.924962:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9652e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63000e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925022:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925036:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925046:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925060:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925065:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925070:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925361:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925370:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925397:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135963.925435:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789135963.925438:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135963.925454:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925466:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925474:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925481:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925652:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925661:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135963.925664:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925672:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925682:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135963.925685:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135963.925690:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925728:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925753:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925758:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925764:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925769:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135963.925772:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925778:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925786:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba069d75e00) 00010000:00010000:1.0:1789135963.925789:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135963.925792:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925797:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf9653c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925828:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9652e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925841:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.925854:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:1.0:1789135963.925856:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135963.925859:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6200, rc 0) 00000100:00100000:1.0:1789135963.926007:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10672:x1876044696035968:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1087us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.926015:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 67 00010000:00010000:0.0:1789135963.980984:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135964.749629:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135964.749637:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135964.749681:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135964.749688:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135964.749848:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723329664:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135964.749950:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135964.764949:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723329664:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135964.765600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135964.766185:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036096 00000100:00100000:1.0:1789135964.766195:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036096 00000100:00100000:1.0:1789135964.766269:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:1.0:1789135964.766280:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036096:12345-192.168.204.41@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789135964.766375:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036096:12345-192.168.204.41@tcp:900:lhsmtool_posix.0 Request processed in 97us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.766383:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:1.0:1789135964.775174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135964.775242:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036224 00000100:00100000:0.0:1789135964.775251:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036224 00000100:00100000:0.0:1789135964.775313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:0.0:1789135964.775324:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036224:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135964.775381:0:5851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135964.775494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036224:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 172us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.775502:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:3.0:1789135964.797946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135964.798055:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036352 00000100:00100000:2.0:1789135964.798066:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036352 00000100:00100000:2.0:1789135964.798135:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:2.0:1789135964.798150:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036352:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789135964.798323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798341:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798383:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798454:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798463:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798470:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798499:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798508:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798515:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135964.798553:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789135964.798557:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135964.798574:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798585:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798592:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798609:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798615:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135964.798619:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798627:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798640:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:2.0:1789135964.798643:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.798647:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798653:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9654a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798664:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798669:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798674:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798678:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135964.798681:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.798696:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799385:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8ba05c1c2400) 00010000:00010000:2.0:1789135964.799387:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.799392:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799398:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96551 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799413:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799420:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799425:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799430:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135964.799433:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799439:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799446:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789135964.799449:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.799451:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.799470:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.799564:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036352:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 Request processed in 1414us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.799574:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:1.0:1789135964.811105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.811180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036608 00000100:00100000:3.0:1789135964.811191:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036608 00000100:00100000:3.0:1789135964.811426:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 70 00000100:00100000:3.0:1789135964.811438:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:10684:x1876044696036608:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135964.811467:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135964.811502:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9655f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630015 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811616:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811631:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811644:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135964.811656:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789135964.811814:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811822:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811828:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811847:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135964.811851:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811859:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811873:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135964.811875:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135964.811880:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811886:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811926:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9655f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630015 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811936:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:3.0:1789135964.811938:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135964.811942:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9655f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630015 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.811952:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135964.812020:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696036608:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 584us (928us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789135964.812027:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 70 00000100:00100000:2.0:1789135964.823382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.824011:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036736 00000100:00100000:3.0:1789135964.824028:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036736 00000100:00100000:3.0:1789135964.824089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:3.0:1789135964.824099:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696036736:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135964.824137:0:5850:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135964.824619:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696036736:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 519us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.824628:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:2.0:1789135964.838472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135964.838547:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696036992 00000100:00100000:1.0:1789135964.838557:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696036992 00000100:00100000:1.0:1789135964.838613:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:1.0:1789135964.838623:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696036992:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135964.838644:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135964.838647:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135964.838677:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630007 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.838697:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135964.838760:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135964.838775:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96574 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63001c expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135964.839578:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789135964.840076:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9657b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.840093:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9657b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.840105:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9657b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.840166:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96574 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63001c expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.840183:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9657b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63001c expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.840191:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba069d75e00) 00010000:00010000:1.0:1789135964.840194:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135964.840197:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7c00, rc 0) 00000100:00100000:1.0:1789135964.840884:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10684:x1876044696036992:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 2257us (2419us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789135964.840895:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:1.0:1789135964.858180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.859724:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696037248 00000100:00100000:3.0:1789135964.859739:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696037248 00000100:00100000:3.0:1789135964.859812:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00100000:3.0:1789135964.859824:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10684:x1876044696037248:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135964.859892:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135964.859920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9657b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63001c expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.859941:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba069d75e00) 00010000:00010000:3.0:1789135964.859951:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135964.859973:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.859987:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.859997:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860012:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860033:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860040:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860412:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860422:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860427:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860433:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135964.860437:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860445:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860454:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135964.860456:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135964.860460:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860623:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860629:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860633:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135964.860637:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860644:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860651:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9be586d5 (ffff8ba05c1e9b00) 00010000:00010000:3.0:1789135964.860654:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135964.860657:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.860663:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9be586d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.860789:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696037248:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 966us (2620us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135964.860797:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00100000:3.0:1789135964.863829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.863860:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696037376 00000100:00100000:3.0:1789135964.863870:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696037376 00000100:00100000:3.0:1789135964.863922:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:3.0:1789135964.863933:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10684:x1876044696037376:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135964.863971:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135964.863996:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630023 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864034:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864049:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864062:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864177:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864196:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.864204:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135964.864207:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135964.865147:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789135964.865312:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10684:x1876044696037376:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1379us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.865321:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:2.0:1789135964.872468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.872617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696037632 00000100:00100000:3.0:1789135964.872627:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696037632 00000100:00100000:3.0:1789135964.872911:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:3.0:1789135964.872924:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10684:x1876044696037632:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135964.873025:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.873044:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.873059:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135964.873618:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789135964.873631:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438747929669ns, next at 439747926669ns, rc = 0 00000004:00010000:2.0:1789135964.874327:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c374a145 reply state 000000003ad8c838 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.874340:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135964.874517:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10684:x1876044696037632:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 1593us (2055us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789135964.874527:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 75 00010000:00010000:3.0:1789135964.879736:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879756:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879764:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879770:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135964.879775:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879783:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879800:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135964.879804:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135964.879809:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.879824:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.880690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135964.880937:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696037760 00000100:00100000:1.0:1789135964.880946:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696037760 00000100:00100000:1.0:1789135964.881000:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 76 00000100:00100000:1.0:1789135964.881011:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:10684:x1876044696037760:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135964.881034:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135964.881053:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63002a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.881123:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.881138:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.881155:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:1.0:1789135964.881158:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135964.881161:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7e00, rc 0) 00000100:00100000:1.0:1789135964.881236:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10684:x1876044696037760:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 226us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.881244:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 76 00000100:00100000:1.0:1789135964.889560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135964.889648:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696037888 00000100:00100000:3.0:1789135964.889658:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696037888 00000100:00100000:3.0:1789135964.889725:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:3.0:1789135964.889734:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1876044696037888:12345-192.168.204.41@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789135964.889768:0:6700:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1789135964.893950:0:6700:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf965b3 00002000:00100000:2.0:1789135964.893973:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8ba085f42800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135964.893988:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135964.894262:0:6700:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135964.894304:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b9f478e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135964.894399:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044696037888:12345-192.168.204.41@tcp:8:lhsmtool_posix.0 Request processed in 4662us (4844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.894410:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:0.0:1789135964.897119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135964.897187:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696038016 00000100:00100000:2.0:1789135964.897220:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696038016 00000100:00100000:2.0:1789135964.897297:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:2.0:1789135964.897307:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044696038016:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789135964.898108:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789135964.942858:0:12421:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135964.942870:0:12421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135964.942909:0:12421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789135964.942916:0:12421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789135964.978432:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1789135964.978450:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000100:00100000:0.0:1789135964.978727:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:0:x1876044696038016:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 81390us (81586us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789135964.978740:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:0.0:1789135964.999904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135964.999981:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696038272 00000100:00100000:1.0:1789135964.999992:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696038272 00000100:00100000:1.0:1789135965.000059:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:1.0:1789135965.000078:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10684:x1876044696038272:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789135965.000363:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10684:x1876044696038272:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 283us (458us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789135965.000381:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00010000:00010000:3.0:1789135965.005848:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135965.015933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.019294:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696038528 00000100:00100000:1.0:1789135965.019312:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696038528 00000100:00100000:0.0:1789135965.021986:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:0.0:1789135965.022001:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10684:x1876044696038528:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135965.022278:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10684:x1876044696038528:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 279us (6356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.022286:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:0.0:1789135965.027635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135965.027675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696038656 00000100:00100000:0.0:1789135965.027685:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696038656 00000100:00100000:0.0:1789135965.027756:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:0.0:1789135965.027766:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10684:x1876044696038656:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135965.027787:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135965.027809:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630031 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.027876:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.027898:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.027909:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135965.027947:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135965.027968:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.027994:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630031 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.028009:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630031 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.028018:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:0.0:1789135965.028021:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135965.028025:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030200, rc 0) 00000100:00100000:0.0:1789135965.028078:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10684:x1876044696038656:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 314us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.028085:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00080000:1.0:1789135965.033382:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135965.033968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.034036:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696038784 00000100:00100000:1.0:1789135965.034046:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696038784 00000100:00100000:1.0:1789135965.034117:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:1.0:1789135965.034128:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2364:x1876044696038784:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135965.034146:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135965.034166:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630038 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135965.034193:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c5b, blocks: 0x1 00010000:00010000:1.0:1789135965.034214:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789135965.034219:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135965.034229:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.034250:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.034265:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6a00, rc 0) 00000100:00100000:1.0:1789135965.034326:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696038784:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 201us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.034333:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:0.0:1789135965.047019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.047097:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039040 00000100:00100000:3.0:1789135965.047107:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039040 00000100:00100000:3.0:1789135965.047168:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:3.0:1789135965.047178:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10684:x1876044696039040:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789135965.047386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10684:x1876044696039040:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 209us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.047395:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:1.0:1789135965.054281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135965.054378:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039168 00000100:00100000:2.0:1789135965.054387:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039168 00000100:00100000:2.0:1789135965.054445:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789135965.054455:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:10684:x1876044696039168:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135965.054484:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135965.054506:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63003f expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.054539:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.054548:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135965.054552:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135965.054557:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.054590:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.054604:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.054617:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723329792:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135965.054768:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135965.062888:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723329792:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135965.062927:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.062968:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936000, rc 0) 00000100:00100000:0.0:1789135965.063029:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:10684:x1876044696039168:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 8575us (8756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.063039:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789135965.073860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.074023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039296 00000100:00100000:1.0:1789135965.074033:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039296 00010000:00010000:1.0:1789135965.074143:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.074219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:1.0:1789135965.074230:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696039296:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135965.074247:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135965.074271:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.074284:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.074307:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021578d5/0x38eb79866bf965c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630038 expref: 7 pid: 6697 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.074323:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135965.074328:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135965.074336:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.074347:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.074399:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.074423:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723329920:192.168.204.41@tcp:105: 00000100:00100000:1.0:1789135965.074516:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0580f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135965.080096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.080142:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039424 00000100:00100000:3.0:1789135965.080152:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039424 00002000:00100000:3.0:1789135965.080201:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ba0412aa580 x1876044696039424/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:396/0 lens 504/0 e 0 to 0 dl 1789135976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135965.080231:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba0412aa580 with x1876044696039424 ext(0->8) 00002000:00010000:3.0:1789135965.080238:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba0412aa580 00000100:00100000:3.0:1789135965.080267:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:3.0:1789135965.080276:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696039424:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789135965.080979:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696039424:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 Request processed in 701us (891us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789135965.080987:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00002000:00100000:3.0:1789135965.080995:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ba0412aa580 x1876044696039424/t4294967302(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:396/0 lens 504/448 e 0 to 0 dl 1789135976 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135965.081004:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba0412aa580 with x1876044696039424 ext(0->8) 00002000:00010000:3.0:1789135965.081008:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba0412aa580 00000100:00100000:3.0:1789135965.081061:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e1e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723329920:192.168.204.41@tcp:105: 00010000:00010000:3.0:1789135965.081083:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135965.081108:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696039296:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 6880us (7260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.081117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:1.0:1789135965.097997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135965.098075:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039552 00000100:00100000:2.0:1789135965.098086:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039552 00000100:00100000:2.0:1789135965.098146:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:2.0:1789135965.098158:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10684:x1876044696039552:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789135965.202171:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:3.0:1789135965.202193:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1789135965.202213:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1789135965.202233:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1789135965.202402:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10684:x1876044696039552:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 Request processed in 104239us (104410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.202413:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:1.0:1789135965.203759:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135965.203778:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723330048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135965.203843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135965.203902:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723330048 00000100:00100000:1.0:1789135965.203909:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723330048 00000100:00100000:1.0:1789135965.203960:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135965.203970:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723330048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789135965.204137:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789135965.204141:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135964 00002000:00010000:1.0:1789135965.204143:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135965.204145:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135963 -> 1789135964 00002000:00010000:1.0:1789135965.204146:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789135965.204185:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723330048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (342us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789135965.204192:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789135965.204212:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789135965.204249:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba05c3e3480/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789135965.204255:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723330048:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789135965.204398:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789135965.204412:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789135965.207033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.207101:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039680 00000100:00100000:1.0:1789135965.207110:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039680 00000100:00100000:1.0:1789135965.207161:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:1.0:1789135965.207171:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696039680:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789135965.242519:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696039680:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 Request processed in 35337us (35483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.242533:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 30 00000001:00080000:0.0:1789135965.242681:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789135965.242694:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1789135965.245742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.245823:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696039936 00000100:00100000:3.0:1789135965.245835:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696039936 00000100:00100000:3.0:1789135965.245901:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:3.0:1789135965.245911:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10684:x1876044696039936:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135965.245967:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135965.245996:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630031 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.246017:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135965.246021:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135965.246051:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.246247:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.246259:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135965.246618:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008c99d867 reply state 000000004981c470 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.246628:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135965.246831:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10684:x1876044696039936:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 921us (1100us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789135965.246841:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:2.0:1789135965.251226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.251320:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040064 00000100:00100000:1.0:1789135965.251331:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040064 00000100:00100000:1.0:1789135965.251395:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 31 00000100:00100000:1.0:1789135965.251405:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696040064:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789135965.251693:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789135965.251697:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789135964 -> 1789135962 00002000:00010000:1.0:1789135965.251724:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789135960 00002000:00010000:1.0:1789135965.251727:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135964 -> 1789135962 00002000:00010000:1.0:1789135965.251729:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789135965.251796:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696040064:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 391us (579us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789135965.251804:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 31 00010000:00010000:3.0:1789135965.254056:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254153:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254160:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254166:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135965.254171:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254178:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254197:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135965.254200:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.254205:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.254211:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf965d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.254520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.254694:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040320 00000100:00100000:3.0:1789135965.254884:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040320 00000100:00100000:3.0:1789135965.254948:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 82 00000100:00100000:3.0:1789135965.254956:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10684:x1876044696040320:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789135965.255025:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.255039:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 13 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.255074:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.255125:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 13 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.255138:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 13 pid: 8031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.255151:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723330176:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135965.255251:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d35180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135965.257835:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723330176:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135965.257867:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.259422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135965.259520:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040448 00000100:00100000:2.0:1789135965.259529:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040448 00010000:00010000:2.0:1789135965.259570:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 14 pid: 8031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.259611:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:2.0:1789135965.259621:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2363:x1876044696040448:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135965.259638:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135965.259645:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 14 pid: 8031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259657:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 14 pid: 8031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259682:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9659e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630023 expref: 14 pid: 8031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259763:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:2.0:1789135965.259769:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259779:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259787:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.259814:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135965.259866:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696040448:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 246us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.259874:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 48 00010000:00010000:3.0:1789135965.259952:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.259961:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.259987:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.259994:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.260000:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.260005:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135965.260009:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.260026:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.260036:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135965.260038:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789135965.260042:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.260047:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.260092:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:10684:x1876044696040320:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 Request processed in 5136us (5576us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789135965.260100:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 82 00000100:00100000:3.0:1789135965.263893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135965.263991:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040576 00000100:00100000:1.0:1789135965.264002:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040576 00000100:00100000:1.0:1789135965.264078:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:1.0:1789135965.264089:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696040576:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789135965.264170:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.264190:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.264199:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789135965.264203:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135965.264208:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.264243:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.264257:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 7 pid: 6698 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.264271:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723330304:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135965.264368:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebe780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135965.268358:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723330304:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135965.268394:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.270492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135965.270584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040704 00000100:00100000:2.0:1789135965.270593:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040704 00010000:00010000:2.0:1789135965.270635:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 8 pid: 6698 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.270678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:2.0:1789135965.270688:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696040704:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135965.270739:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135965.270775:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 8 pid: 6698 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.270789:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 8 pid: 6698 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.270815:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf965cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63003f expref: 8 pid: 6698 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.270833:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135965.270837:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135965.270843:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.270852:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.270889:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135965.270944:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059225c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696040704:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 258us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.270953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00010000:00010000:1.0:1789135965.271402:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271414:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271439:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271455:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271464:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271471:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135965.271476:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271486:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271499:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.271507:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6328349/0x38eb79866bf965e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.271571:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696040576:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 Request processed in 7483us (7688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.271581:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:3.0:1789135965.275104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135965.275643:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696040960 00000100:00100000:0.0:1789135965.275655:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696040960 00000100:00100000:0.0:1789135965.275911:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:0.0:1789135965.275923:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:10684:x1876044696040960:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135965.276010:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276028:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276040:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276384:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276397:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276405:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276460:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.276487:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 13 pid: 5851 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135965.276502:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723330432:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135965.276597:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512d2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135965.280764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.280865:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696041088 00000100:00100000:3.0:1789135965.280874:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696041088 00010000:00010000:3.0:1789135965.280916:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 14 pid: 5851 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.280959:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789135965.280968:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2364:x1876044696041088:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135965.280983:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135965.280990:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 14 pid: 5851 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.281022:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 14 pid: 5851 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.281047:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135965.281053:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.281073:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.281082:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.281101:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135965.281183:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2364:x1876044696041088:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 207us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.281191:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 50 00010000:00010000:2.0:1789135965.282821:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf965ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63002a expref: 13 pid: 5851 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.282846:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073cea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723330432:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135965.282871:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.282901:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.282906:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135965.283339:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789135965.283588:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789135965.283639:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789135965.283865:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074303840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723330560:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789135965.283930:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135965.284017:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135965.284428:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723330560 00000100:00100000:0.0:1789135965.284435:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723330560 00000100:00100000:0.0:1789135965.284599:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135965.284609:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723330560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789135965.284731:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723330560:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.284738:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135965.284817:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789135965.284824:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba05c3e3480, transno 4294967303 00000100:00100000:3.0:1789135965.284838:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074303840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723330560:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789135965.285438:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789135965.285525:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723330688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789135965.285564:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135965.286297:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135965.286790:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723330688 00000100:00100000:2.0:1789135965.286797:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723330688 00000100:00100000:2.0:1789135965.286833:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135965.286842:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723330688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789135965.287174:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723330688:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789135965.287223:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287243:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287250:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287255:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135965.287260:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287267:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287283:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba05c1e9f00) 00010000:00010000:3.0:1789135965.287286:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135965.287292:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287297:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf965f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287337:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287342:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287360:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287364:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135965.287373:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287379:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287387:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135965.287390:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135965.287393:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287401:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96527 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287424:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287437:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287445:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287487:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.287503:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 16 pid: 5850 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.287515:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723330816:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135965.287766:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1876044723330688:12345-0@lo:1000:mdt00_002.0 Request processed in 218us (1494us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789135965.287777:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135965.287858:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135965.291962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135965.292058:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723330816:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135965.292100:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.292611:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696041216 00000100:00100000:2.0:1789135965.292619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696041216 00010000:00010000:2.0:1789135965.292660:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 17 pid: 5850 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.292723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:2.0:1789135965.292734:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:2364:x1876044696041216:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135965.292748:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135965.292769:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 17 pid: 5850 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292781:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 17 pid: 5850 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292803:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63000e expref: 17 pid: 5850 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292818:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789135965.292823:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292833:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292841:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.292868:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135965.292930:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2364:x1876044696041216:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 198us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.292938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 51 00010000:00010000:1.0:1789135965.293940:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.293969:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.293982:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.293989:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.293996:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294003:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135965.294008:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294016:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294030:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:1.0:1789135965.294032:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135965.294037:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294043:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf965f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294057:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294076:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294089:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294094:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135965.294098:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294105:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294113:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:1.0:1789135965.294116:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135965.294134:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.294141:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf965eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.294926:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10684:x1876044696040960:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 19001us (19828us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789135965.294937:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 83 00000020:00080000:1.0:1789135965.294944:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789135965.300950:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135965.300960:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135965.300994:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135965.301000:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135965.301848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135965.301951:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696041472 00000100:00100000:0.0:1789135965.301961:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696041472 00000100:00100000:0.0:1789135965.302048:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:0.0:1789135965.302059:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10684:x1876044696041472:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789135965.307128:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789135965.309563:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789135965.309665:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309686:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309727:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309738:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309744:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309751:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.309771:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789135965.309888:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:10684:x1876044696041472:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 7826us (8044us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789135965.309900:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000020:00080000:0.0:1789135965.309908:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135965.310400:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135965.310409:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.310416:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135965.310419:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.310437:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.310453:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ba06ca52500) 00010000:00010000:1.0:1789135965.310456:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789135965.310462:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.310468:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96600 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.310501:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135965.310502:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135965.310504:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135966.029138:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135966.353491:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135966.353501:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135966.353535:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789135966.353541:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789135967.050463:0:12473:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135967.050474:0:12473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135967.050511:0:12473:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135967.050517:0:12473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789135967.051232:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:1.0:1789135967.051249:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1789135967.054512:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135967.242129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135967.242170:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696041728 00000100:00100000:2.0:1789135967.242179:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696041728 00000100:00100000:2.0:1789135967.242243:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:2.0:1789135967.242253:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:10702:x1876044696041728:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135967.242277:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135967.242318:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96607 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630046 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.243566:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937800/0x38eb79866bf9660e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.243588:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937800/0x38eb79866bf9660e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.243605:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937800/0x38eb79866bf9660e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135967.243620:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789135967.243854:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96607 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630046 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.243873:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937800/0x38eb79866bf9660e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630046 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.243882:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135967.243886:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135967.243890:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937800, rc 0) 00000100:00100000:2.0:1789135967.243973:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10702:x1876044696041728:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1722us (1850us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789135967.243982:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00080000:2.0:1789135967.244017:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135967.265060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135967.265100:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696041856 00000100:00100000:2.0:1789135967.265111:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696041856 00000100:00100000:2.0:1789135967.265161:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:2.0:1789135967.265181:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10702:x1876044696041856:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:2.0:1789135967.265259:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265279:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265294:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265320:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265328:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265336:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265628:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265637:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265645:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135967.265687:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265723:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265736:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265743:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265750:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135967.265754:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265763:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265775:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135967.265778:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135967.265782:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265787:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9661c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265799:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265805:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265811:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265816:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135967.265826:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265832:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265840:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2600) 00010000:00010000:2.0:1789135967.265842:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135967.265845:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265851:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265864:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265870:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265876:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265881:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135967.265883:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265889:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.265895:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1c2c00) 00010000:00010000:2.0:1789135967.265897:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135967.267365:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.267376:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf9662a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.267493:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0743021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10702:x1876044696041856:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 2308us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135967.267504:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:2.0:1789135967.364995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135967.365100:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696042112 00000100:00100000:3.0:1789135967.365111:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696042112 00000100:00100000:3.0:1789135967.365180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 86 00000100:00100000:3.0:1789135967.365192:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10705:x1876044696042112:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135967.365216:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135967.365239:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63004d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365321:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365336:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365348:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365364:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365392:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365751:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365760:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.365767:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135967.365776:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789135967.366278:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366289:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366296:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366302:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135967.366319:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366327:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366351:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135967.366354:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.366359:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366365:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366379:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366385:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366392:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366397:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135967.366399:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366405:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366411:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9f00) 00010000:00010000:1.0:1789135967.366414:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.366416:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366421:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9663f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366471:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366483:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.366490:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135967.366492:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135967.366495:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:1.0:1789135967.366561:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10705:x1876044696042112:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1371us (1576us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789135967.366569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 86 00000100:00100000:2.0:1789135967.374396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.374480:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696042240 00000100:00100000:1.0:1789135967.374490:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696042240 00000100:00100000:1.0:1789135967.374556:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:1.0:1789135967.374565:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10705:x1876044696042240:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:1.0:1789135967.374647:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374664:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374677:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374758:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374783:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374789:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374795:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135967.374799:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374806:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374820:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135967.374822:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135967.374828:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.374833:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.374927:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10705:x1876044696042240:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 363us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135967.374935:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:2.0:1789135967.379106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.379197:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696042496 00000100:00100000:1.0:1789135967.379207:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696042496 00000100:00100000:1.0:1789135967.379271:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:1.0:1789135967.379282:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10705:x1876044696042496:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135967.379547:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:10705:x1876044696042496:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 266us (450us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789135967.379569:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:3.0:1789135967.464834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135967.465100:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696042752 00000100:00100000:2.0:1789135967.465110:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696042752 00000100:00100000:2.0:1789135967.465176:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:2.0:1789135967.465186:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:10226:x1876044696042752:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135967.465212:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135967.465235:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9665b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630054 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.465365:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.465380:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.465389:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.465435:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.465457:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 23 pid: 5851 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.465471:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085de03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723330944:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135967.465567:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135967.469926:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085de03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723330944:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135967.469958:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.473386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135967.474505:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696042880 00000100:00100000:2.0:1789135967.474519:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696042880 00010000:00010000:2.0:1789135967.474574:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 24 pid: 5851 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.474623:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 52 00000100:00100000:2.0:1789135967.474635:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2363:x1876044696042880:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135967.474650:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135967.474658:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 24 pid: 5851 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.474674:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 24 pid: 5851 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.474697:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63004d expref: 24 pid: 5851 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.477055:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135967.477069:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.477104:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.477112:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.477165:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135967.477251:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2363:x1876044696042880:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2613us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135967.477261:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 52 00010000:00010000:3.0:1789135967.478495:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.478508:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135967.478530:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789135967.478808:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf9665b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.478830:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.478849:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135967.478852:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789135967.478856:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936e00, rc 0) 00000100:00100000:3.0:1789135967.479874:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10226:x1876044696042752:12345-192.168.204.41@tcp:101:bash.0 Request processed in 14679us (15042us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789135967.479886:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:3.0:1789135967.485541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.485670:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043136 00000100:00100000:1.0:1789135967.485682:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043136 00000100:00100000:1.0:1789135967.485785:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:1.0:1789135967.485797:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10226:x1876044696043136:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:1.0:1789135967.486334:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.486354:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.486366:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135967.486421:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789135967.486450:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e314d837 reply state 00000000b0a80451 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.486460:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789135967.486509:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789135967.486622:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10226:x1876044696043136:12345-192.168.204.41@tcp:36:bash.0 Request processed in 825us (1089us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789135967.486630:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 89 00000020:00080000:1.0:1789135967.486635:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789135967.499093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00010000:00010000:3.0:1789135967.499268:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499282:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499291:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499297:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135967.499315:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499323:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499340:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135967.499343:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.499348:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.499355:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.500695:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043264 00000100:00100000:1.0:1789135967.500738:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043264 00000100:00100000:1.0:1789135967.500807:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 90 00000100:00100000:1.0:1789135967.500817:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10226:x1876044696043264:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:1.0:1789135967.500845:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135967.500880:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63005b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.500959:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63005b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.500975:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63005b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.500996:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135967.500999:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135967.501003:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789135967.501081:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10226:x1876044696043264:12345-192.168.204.41@tcp:101:bash.0 Request processed in 265us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135967.501089:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 90 00000100:00100000:0.0:1789135967.520399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.520669:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043392 00000100:00100000:1.0:1789135967.520679:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043392 00000100:00080000:2.0:1789135967.521443:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135967.521665:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:1.0:1789135967.521682:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:10226:x1876044696043392:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:1.0:1789135967.521747:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135967.521772:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630062 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135967.521805:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40c5a, atime: 0x6aa40c58, ctime: 0x6aa40c5a, blocks: 0xb 00010000:00010000:1.0:1789135967.521830:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789135967.521835:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135967.521844:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.521879:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.521894:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7a00, rc 0) 00000100:00100000:1.0:1789135967.521973:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:10226:x1876044696043392:12345-192.168.204.41@tcp:101:bash.0 Request processed in 296us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135967.521980:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:2.0:1789135967.529994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.530490:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043520 00000100:00100000:1.0:1789135967.530500:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043520 00002000:00010000:1.0:1789135967.530545:0:6703:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1789135967.530550:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085de0f00 with x1876044696043520 ext(0->18446744073709551615) 00002000:00010000:1.0:1789135967.530561:0:6703:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085de0f00. 00000100:00100000:1.0:1789135967.530598:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:1.0:1789135967.530608:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696043520:12345-192.168.204.41@tcp:10:bash.0 00002000:00010000:1.0:1789135967.531068:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789135967.531072:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789135962 -> 1789135966 00002000:00010000:1.0:1789135967.531074:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789135960 -> 1789135960 00002000:00010000:1.0:1789135967.531076:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135962 -> 1789135966 00002000:00010000:1.0:1789135967.531078:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789135967.531150:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696043520:12345-192.168.204.41@tcp:10:bash.0 Request processed in 543us (1167us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789135967.531159:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00002000:00010000:1.0:1789135967.531163:0:6703:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1789135967.531167:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085de0f00 with x1876044696043520 ext(0->18446744073709551615) 00002000:00010000:1.0:1789135967.531186:0:6703:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085de0f00. 00000100:00100000:2.0:1789135967.683393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135967.683495:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043648 00000100:00100000:3.0:1789135967.683505:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043648 00000100:00100000:3.0:1789135967.683571:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:3.0:1789135967.683582:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10719:x1876044696043648:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:3.0:1789135967.683667:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.683684:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.683724:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.683755:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.683764:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.683771:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684071:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684081:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684088:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135967.684141:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684154:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684161:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684169:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684174:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135967.684178:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684186:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684198:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135967.684201:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.684206:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684212:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684225:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684231:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684244:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684250:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135967.684253:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684260:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684268:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9b00) 00010000:00010000:3.0:1789135967.684271:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.684274:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684279:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9668c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684293:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684311:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684318:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684323:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135967.684325:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684342:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684352:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135967.684354:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.684357:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.684364:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.684442:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10719:x1876044696043648:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 862us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.684451:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:0.0:1789135967.794542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.794665:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696043904 00000100:00100000:1.0:1789135967.794677:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696043904 00000100:00100000:1.0:1789135967.794777:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:1.0:1789135967.794787:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:10722:x1876044696043904:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135967.794809:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135967.794830:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf9669a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630069 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794918:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794932:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794944:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794960:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794967:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.794974:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795285:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf966af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795296:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf966af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795325:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf966af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135967.795337:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789135967.795434:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795441:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795447:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795453:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135967.795457:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795464:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795477:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135967.795480:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.795485:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795491:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795504:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795510:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795521:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795526:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135967.795529:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795534:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795542:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba069d75d00) 00010000:00010000:1.0:1789135967.795545:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.795548:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795553:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795594:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf9669a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630069 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795607:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf966af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630069 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.795613:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135967.795616:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135967.795618:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6c00, rc 0) 00000100:00100000:1.0:1789135967.795689:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10722:x1876044696043904:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 903us (1160us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789135967.795755:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:2.0:1789135967.804471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135967.804560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696044032 00000100:00100000:3.0:1789135967.804570:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696044032 00000100:00100000:3.0:1789135967.804636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:3.0:1789135967.804646:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10722:x1876044696044032:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135967.804752:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.804769:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 29 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.804779:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.804816:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 29 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.804852:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 29 pid: 8031 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.804867:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723331072:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135967.804973:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135967.811263:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723331072:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135967.811295:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.820800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.820931:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696044288 00000100:00100000:1.0:1789135967.820941:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696044288 00000100:00100000:1.0:1789135967.820991:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:1.0:1789135967.821000:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:5607:x1876044696044288:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135967.821332:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:5607:x1876044696044288:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 332us (542us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789135967.821340:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:2.0:1789135967.825441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135967.825545:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696044416 00000100:00100000:0.0:1789135967.825555:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696044416 00010000:00010000:0.0:1789135967.825600:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 31 pid: 8031 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135967.825659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:0.0:1789135967.825670:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:2364:x1876044696044416:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135967.825687:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135967.825694:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 31 pid: 8031 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825747:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 31 pid: 8031 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825772:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630054 expref: 31 pid: 8031 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825789:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789135967.825795:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825804:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825811:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.825847:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135967.825908:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:2364:x1876044696044416:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 239us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135967.825915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00010000:00010000:2.0:1789135967.826153:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826162:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826188:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826194:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826200:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826213:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135967.826218:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826225:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826234:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135967.826237:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135967.826241:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135967.826247:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf966bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.826287:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10722:x1876044696044032:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 21642us (21826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135967.826295:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:3.0:1789135967.829809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135967.830015:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696044672 00000100:00100000:1.0:1789135967.830025:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696044672 00000100:00100000:1.0:1789135967.830077:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:1.0:1789135967.830087:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:10722:x1876044696044672:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135967.830392:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10722:x1876044696044672:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 305us (594us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789135967.830401:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:1.0:1789135968.003350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.003569:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696044928 00000100:00100000:2.0:1789135968.003588:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696044928 00000100:00100000:2.0:1789135968.004916:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00100000:2.0:1789135968.004933:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:10733:x1876044696044928:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:2.0:1789135968.004961:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135968.004984:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf966c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630070 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005060:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005095:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005107:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005125:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005132:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005139:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005480:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf966d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005490:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf966d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005499:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf966d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135968.005509:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789135968.005604:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005612:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005618:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005632:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.005636:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005644:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005657:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135968.005661:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.005666:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.005672:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf966cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006113:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006122:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006129:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006134:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.006137:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006144:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006163:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2c00) 00010000:00010000:2.0:1789135968.006166:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.006170:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006176:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf966d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006222:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf966c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630070 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006236:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf966d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630070 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.006244:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135968.006246:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135968.006248:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937e00, rc 0) 00000100:00100000:2.0:1789135968.006338:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:10733:x1876044696044928:12345-192.168.204.41@tcp:101:cat.0 Request processed in 1412us (2998us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789135968.006347:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00100000:2.0:1789135968.015095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.015250:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696045184 00000100:00100000:1.0:1789135968.015262:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696045184 00000100:00100000:1.0:1789135968.015332:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:1.0:1789135968.015345:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:10733:x1876044696045184:12345-192.168.204.41@tcp:35:cat.0 00000100:00100000:1.0:1789135968.015633:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10733:x1876044696045184:12345-192.168.204.41@tcp:35:cat.0 Request processed in 290us (547us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789135968.015641:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:0.0:1789135968.056883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.056996:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696045440 00000100:00100000:1.0:1789135968.057021:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696045440 00000100:00100000:1.0:1789135968.057080:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 95 00000100:00100000:1.0:1789135968.057089:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10734:x1876044696045440:12345-192.168.204.41@tcp:36:rm.0 00010000:00010000:1.0:1789135968.057145:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135968.057172:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf966d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630070 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057194:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf966af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630069 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057206:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63005b expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057215:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135968.057224:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135968.057244:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057257:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057267:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057280:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057286:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057291:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057626:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057636:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.057643:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135968.058357:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789135968.058368:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441932667677ns, next at 442932664559ns, rc = 0 00010000:00010000:1.0:1789135968.058439:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058451:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058460:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058468:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058474:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058481:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058511:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135968.058531:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058545:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058551:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058556:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135968.058561:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058568:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058578:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba069d75e00) 00010000:00010000:1.0:1789135968.058580:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135968.058585:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf966f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058616:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058621:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058626:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135968.058634:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058641:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058649:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135968.058652:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.058655:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.058661:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf966e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135968.058671:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007714d0a7 reply state 0000000064359436 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.058679:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135968.058788:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:10734:x1876044696045440:12345-192.168.204.41@tcp:36:rm.0 Request processed in 1697us (1912us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789135968.058797:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 95 00010000:00010000:0.0:1789135968.059159:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135968.059167:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.059173:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135968.059177:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.059185:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.059195:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ba069d75e00) 00010000:00010000:0.0:1789135968.059198:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135968.059201:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.059206:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf966fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.059221:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135968.059222:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135968.059224:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135968.060930:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.060945:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.060953:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.060959:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135968.060963:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.060985:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.061000:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba069d75d00) 00010000:00010000:0.0:1789135968.061003:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.061018:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.061025:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf966ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.076942:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135968.101446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.101620:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696045696 00000100:00100000:2.0:1789135968.101631:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696045696 00000100:00100000:2.0:1789135968.101683:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 96 00000100:00100000:2.0:1789135968.101692:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:10740:x1876044696045696:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135968.101736:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135968.101757:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96703 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630077 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101895:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101911:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101923:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101938:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101946:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.101952:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135968.102564:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789135968.102759:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102771:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102778:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102813:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102831:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102837:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102843:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.102847:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102855:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102867:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135968.102870:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.102875:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102881:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9670a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135968.102896:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000092371cd7 reply state 00000000635b5531 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.102904:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789135968.102935:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96703 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102947:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.102965:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:2.0:1789135968.102967:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135968.102970:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937200, rc 0) 00000100:00100000:2.0:1789135968.103057:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:10740:x1876044696045696:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1366us (1621us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789135968.103064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 96 00010000:00010000:0.0:1789135968.105372:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105390:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105397:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105403:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135968.105409:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105416:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105434:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2c00) 00010000:00010000:0.0:1789135968.105437:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.105457:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.105465:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.112381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.115426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.119265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.119313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.119352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696045952 00000100:00100000:0.0:1789135968.119352:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046208 00000100:00100000:3.0:1789135968.119362:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696045952 00000100:00100000:0.0:1789135968.119362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046208 00000100:00080000:0.0:1789135968.119391:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135968.119416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 324 00000100:00100000:3.0:1789135968.119426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696045952:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135968.119432:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 161 00000100:00100000:0.0:1789135968.119438:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696046208:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135968.119499:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696045952:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.119508:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 324 00000100:00100000:1.0:1789135968.122027:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696045824 00000100:00100000:1.0:1789135968.122041:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696045824 00000100:00100000:1.0:1789135968.126408:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046080 00000100:00100000:1.0:1789135968.126437:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046080 00000100:00100000:1.0:1789135968.126511:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:1.0:1789135968.126523:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696046080:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135968.127213:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696046208:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 7769us (7893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.127226:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 161 00000100:00100000:0.0:1789135968.127267:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:0.0:1789135968.127278:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696045824:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:0.0:1789135968.127304:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.127327:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63007e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135968.127356:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135968.127376:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1789135968.127382:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135968.127392:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.127443:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.127457:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030200, rc 0) 00000100:00100000:0.0:1789135968.127490:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696045824:12345-192.168.204.41@tcp:101:bash.0 Request processed in 214us (15120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.127496:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00080000:0.0:1789135968.127565:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135968.136598:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696046080:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 10053us (21168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.136615:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:0.0:1789135968.137736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.137996:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046336 00000100:00100000:2.0:1789135968.138006:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046336 00000100:00100000:2.0:1789135968.138067:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 35 00000100:00100000:2.0:1789135968.138076:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:10740:x1876044696046336:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135968.138096:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135968.138118:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630085 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.138155:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.138164:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135968.138168:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135968.138173:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.138206:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.138236:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.138252:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876044723331200:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135968.138413:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.156974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.157014:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1876044723331200:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135968.157053:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.157079:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937600, rc 0) 00000100:00100000:1.0:1789135968.157113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046464 00000100:00100000:1.0:1789135968.157132:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046464 00000100:00100000:2.0:1789135968.157138:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:10740:x1876044696046336:12345-192.168.204.41@tcp:101:bash.0 Request processed in 19063us (19407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.157146:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 35 00010000:00010000:1.0:1789135968.157167:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.157210:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:1.0:1789135968.157219:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696046464:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.157233:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135968.157255:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.157267:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.157301:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d3854fe/0x38eb79866bf96726 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63007e expref: 7 pid: 6700 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.157316:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135968.157321:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135968.157329:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.157339:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.157372:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.157402:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1876044723331328:192.168.204.41@tcp:105: 00000100:00100000:1.0:1789135968.157464:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135968.161022:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1876044723331328:192.168.204.41@tcp:105: 00010000:00010000:1.0:1789135968.161049:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.161103:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696046464:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 3884us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.161116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:0.0:1789135968.164810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.164910:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046720 00000100:00100000:1.0:1789135968.164920:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046720 00000100:00100000:1.0:1789135968.164983:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:1.0:1789135968.164993:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:10740:x1876044696046720:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:1.0:1789135968.165589:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:10740:x1876044696046720:12345-192.168.204.41@tcp:35:bash.0 Request processed in 595us (788us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789135968.165598:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:0.0:1789135968.379990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.380218:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696046848 00000100:00100000:2.0:1789135968.380227:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696046848 00000100:00100000:2.0:1789135968.380339:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 97 00000100:00100000:2.0:1789135968.380349:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:10756:x1876044696046848:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135968.380372:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135968.380394:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63008c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380466:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380493:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380507:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135968.380563:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789135968.380566:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135968.380588:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380614:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63008c expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380632:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63008c expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.380641:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135968.380644:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135968.380648:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936400, rc 0) 00000100:00100000:2.0:1789135968.380766:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:10756:x1876044696046848:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 419us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.380774:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 97 00000100:00100000:3.0:1789135968.399442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.399940:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047104 00000100:00100000:0.0:1789135968.399950:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047104 00000100:00100000:0.0:1789135968.400027:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:0.0:1789135968.400036:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:10756:x1876044696047104:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135968.400058:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.400081:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630093 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.400190:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.400205:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.400239:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135968.400251:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789135968.400649:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630093 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.400671:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630093 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.400680:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:0.0:1789135968.400683:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135968.400686:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030400, rc 0) 00000100:00100000:0.0:1789135968.400804:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:10756:x1876044696047104:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 768us (1371us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789135968.400812:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:0.0:1789135968.408687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.408757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.408950:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047488 00000100:00100000:2.0:1789135968.408961:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047488 00000100:00100000:2.0:1789135968.409045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:2.0:1789135968.409056:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:2364:x1876044696047488:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135968.409073:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135968.409114:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630093 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.409133:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:2.0:1789135968.409138:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135968.409205:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:2364:x1876044696047488:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 150us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.409213:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:3.0:1789135968.409463:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047360 00000100:00100000:3.0:1789135968.409469:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047360 00000100:00100000:3.0:1789135968.409565:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00100000:3.0:1789135968.409575:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:10756:x1876044696047360:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.409597:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.409622:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63009a expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.409761:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.409776:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.409787:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.409799:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789135968.409939:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63009a expref: 39 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.409954:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63009a expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.409962:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:3.0:1789135968.409964:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789135968.409967:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:3.0:1789135968.410234:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:10756:x1876044696047360:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 660us (1556us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789135968.410242:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00100000:0.0:1789135968.417875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.419391:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047616 00000100:00100000:1.0:1789135968.419416:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047616 00000100:00100000:1.0:1789135968.419485:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:1.0:1789135968.419496:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696047616:12345-192.168.204.41@tcp:1:lfs.0 00010000:00010000:1.0:1789135968.419542:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.419564:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.419593:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135968.419598:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135968.419603:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.419639:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.419653:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 6 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.419667:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876044723331456:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135968.419793:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.425973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.426351:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876044723331456:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135968.426380:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.426577:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047744 00000100:00100000:3.0:1789135968.426585:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047744 00002000:00100000:3.0:1789135968.426635:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ba073fc9a40 x1876044696047744/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:399/0 lens 504/0 e 0 to 0 dl 1789135979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135968.426646:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba073fc9a40 with x1876044696047744 ext(0->8) 00010000:00010000:3.0:1789135968.426668:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 7 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.426683:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 7 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135968.426691:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba073fc9a40 00000100:00100000:3.0:1789135968.426758:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:3.0:1789135968.426768:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696047744:12345-192.168.204.41@tcp:4:lfs.0 00000100:00100000:3.0:1789135968.427814:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696047744:12345-192.168.204.41@tcp:4:lfs.0 Request processed in 1042us (1845us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789135968.427824:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00002000:00100000:3.0:1789135968.427833:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ba073fc9a40 x1876044696047744/t4294967302(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:399/0 lens 504/448 e 0 to 0 dl 1789135979 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135968.427840:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba073fc9a40 with x1876044696047744 ext(0->8) 00010000:00010000:3.0:1789135968.427847:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.427862:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135968.427869:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba073fc9a40 00000100:00100000:0.0:1789135968.431489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.432594:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696047872 00000100:00100000:2.0:1789135968.432606:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696047872 00010000:00010000:2.0:1789135968.432650:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.432762:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:2.0:1789135968.432772:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059226450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2365:x1876044696047872:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135968.432788:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789135968.432807:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789135968.432810:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135967 00002000:00010000:2.0:1789135968.432812:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789135967 00002000:00010000:2.0:1789135968.432815:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789135967 00010000:00010000:2.0:1789135968.432821:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.432834:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.432858:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000048d7389/0x38eb79866bf9672d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630085 expref: 9 pid: 6698 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.432902:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135968.432906:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135968.432912:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.432923:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.432965:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135968.433043:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059226450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2365:x1876044696047872:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 272us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.433051:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 55 00010000:00010000:0.0:1789135968.433446:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433457:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433498:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433506:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433514:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433521:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135968.433525:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433534:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433547:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.433555:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9676c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.433626:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696047616:12345-192.168.204.41@tcp:1:lfs.0 Request processed in 14131us (15760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.433634:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:0.0:1789135968.442528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.442611:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696048128 00000100:00100000:1.0:1789135968.445378:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696048128 00000100:00100000:1.0:1789135968.445595:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:1.0:1789135968.445606:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:10756:x1876044696048128:12345-192.168.204.41@tcp:35:lfs.0 00000004:00010000:1.0:1789135968.445672:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63009a expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135968.445992:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789135968.446052:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789135968.447026:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789135968.447099:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.447116:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.447125:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.447160:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.447177:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 42 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.447203:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723331584:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135968.452867:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135968.454096:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723331584:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135968.454143:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.456267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.456534:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696048256 00000100:00100000:2.0:1789135968.456543:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696048256 00010000:00010000:2.0:1789135968.456599:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 43 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.456630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00100000:2.0:1789135968.456640:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+43:2363:x1876044696048256:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135968.456655:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135968.456662:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 43 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456674:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 43 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456749:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630077 expref: 43 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456765:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:2.0:1789135968.456770:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456779:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456786:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.456811:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135968.456871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:2363:x1876044696048256:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 232us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.456879:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 56 00010000:00010000:0.0:1789135968.457095:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.457104:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135968.457240:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789135968.457444:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789135968.457581:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723331712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135968.457635:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135968.457675:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0448e6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135968.458037:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723331712 00000100:00100000:1.0:1789135968.458043:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723331712 00000100:00100000:1.0:1789135968.458098:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135968.458107:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723331712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135968.458200:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723331712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.458207:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789135968.458912:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135968.458947:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789135968.458952:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1789135968.458972:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba073f76940, transno 4294967301 00000100:00100000:0.0:1789135968.458984:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723331712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789135968.460644:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789135968.460766:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723331840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135968.460831:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135968.460862:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135968.461108:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723331840 00000100:00100000:1.0:1789135968.461114:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723331840 00000100:00100000:1.0:1789135968.461182:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135968.461192:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723331840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135968.461791:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1876044723331840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 599us (958us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789135968.461800:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135968.461956:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723331840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789135968.462028:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789135968.462071:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462082:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462107:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462113:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135968.462117:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462125:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462142:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:0.0:1789135968.462145:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789135968.462150:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.462155:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96773 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.463090:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723331968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.463149:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135968.463184:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723332480:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.463213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135968.463238:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135968.463243:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074151a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723332096:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.463267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135968.463488:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0741521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723332224:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.463516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135968.463540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135968.463545:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074152d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723332352:0@lo:400:kworker.0 00000004:00080000:0.0:1789135968.463761:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789135968.463868:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1789135968.463881:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442338180432ns, next at 443338177277ns, rc = 0 00000001:00080000:0.0:1789135968.463890:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789135968.463944:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba05c1c2600) 00010000:00010000:0.0:1789135968.463947:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135968.463956:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9675e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63009a expref: 46 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.464094:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135968.464134:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723331968 00000100:00100000:1.0:1789135968.464140:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723331968 00000100:00100000:1.0:1789135968.464175:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789135968.464183:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723331968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.464248:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723331968:12345-0@lo:400:kworker.0 Request processed in 66us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.464255:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789135968.464780:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723332480 00000100:00100000:3.0:1789135968.464786:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723332480 00000100:00100000:3.0:1789135968.464826:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723332096 00000100:00100000:3.0:1789135968.464830:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723332096 00000100:00100000:3.0:1789135968.464851:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723332224 00000100:00100000:3.0:1789135968.464853:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723332224 00000100:00100000:3.0:1789135968.464865:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789135968.464871:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723332480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135968.464913:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723332480:12345-0@lo:400:kworker.0 Request processed in 43us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.464920:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789135968.464933:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789135968.464938:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723332096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135968.464967:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723332096:12345-0@lo:400:kworker.0 Request processed in 28us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.464973:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789135968.464984:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135968.464990:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723332224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135968.465032:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723332224:12345-0@lo:400:kworker.0 Request processed in 43us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.465038:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135968.465069:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723332608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135968.465096:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135968.465140:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723332608 00000100:00100000:3.0:1789135968.465143:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723332608 00000100:00100000:3.0:1789135968.465165:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135968.465171:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723332608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135968.465184:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135968.465213:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723332608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.465228:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135968.465261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723332608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135968.465303:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723332352 00000100:00100000:3.0:1789135968.465307:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723332352 00000100:00100000:3.0:1789135968.465331:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789135968.465336:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135968.465364:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723332352:12345-0@lo:400:kworker.0 Request processed in 28us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.465370:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789135968.465383:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135968.465386:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135968.465979:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723332096:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.465991:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074153c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723331968:0@lo:400:kworker.0 00000100:00100000:0.0:1789135968.466129:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:10756:x1876044696048128:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 20522us (23610us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789135968.466148:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 26 00000020:00080000:0.0:1789135968.466152:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789135968.466230:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074151e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723332480:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.466268:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074152d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723332352:0@lo:400:kworker.0 00000100:00100000:1.0:1789135968.466278:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0741521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723332224:0@lo:400:kworker.0 00000100:00100000:3.0:1789135968.472503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.472608:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696048384 00000100:00100000:0.0:1789135968.472618:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696048384 00000100:00100000:0.0:1789135968.472678:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 100 00000100:00100000:0.0:1789135968.472688:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:10756:x1876044696048384:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135968.472755:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.472781:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9677a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300a1 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.472847:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9677a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a1 expref: 46 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.472863:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9677a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a1 expref: 46 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.472883:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135968.472886:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135968.472889:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135968.472947:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:10756:x1876044696048384:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 260us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.472954:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 100 00000100:00100000:2.0:1789135968.478360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.478452:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696048640 00000100:00100000:0.0:1789135968.478462:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696048640 00000100:00100000:0.0:1789135968.478524:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:0.0:1789135968.478534:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:10756:x1876044696048640:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:0.0:1789135968.478825:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+47:10756:x1876044696048640:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 292us (474us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789135968.478833:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:2.0:1789135968.633158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.633246:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696048768 00000100:00100000:3.0:1789135968.633257:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696048768 00000100:00100000:3.0:1789135968.633340:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 101 00000100:00100000:3.0:1789135968.633350:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+47:10766:x1876044696048768:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:3.0:1789135968.633457:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633476:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633487:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633503:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633529:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633536:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633664:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633673:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633680:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135968.633762:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633776:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633782:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633789:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633795:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135968.633800:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633807:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633826:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135968.633829:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135968.633834:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633841:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633855:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633860:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633866:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633871:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135968.633873:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633879:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633887:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1e9b00) 00010000:00010000:3.0:1789135968.633889:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135968.633892:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633896:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633921:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633927:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633932:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633938:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135968.633941:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633946:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633953:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135968.633954:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135968.633957:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.633963:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9678f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.634044:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+47:10766:x1876044696048768:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 695us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.634052:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 101 00000100:00100000:3.0:1789135968.691435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.691567:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696049024 00000100:00100000:0.0:1789135968.691577:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696049024 00000100:00100000:0.0:1789135968.691801:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 102 00000100:00100000:0.0:1789135968.691812:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+47:10769:x1876044696049024:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135968.691834:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.691858:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300a8 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692012:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692028:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692038:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692053:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692060:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692066:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692193:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692216:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692224:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135968.692235:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789135968.692415:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692422:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692428:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692434:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135968.692439:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692447:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692459:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789135968.692462:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.692467:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692474:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf9679d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692486:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692498:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692505:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692510:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135968.692513:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692520:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692528:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba06ca52e00) 00010000:00010000:0.0:1789135968.692531:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.692534:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692540:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf967a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692578:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 50 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692592:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 49 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.692598:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135968.692601:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135968.692611:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030600, rc 0) 00000100:00100000:0.0:1789135968.692689:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+49:10769:x1876044696049024:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 879us (1263us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789135968.692802:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 102 00000100:00100000:2.0:1789135968.698274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.698367:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696049152 00000100:00100000:3.0:1789135968.698377:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696049152 00000100:00100000:3.0:1789135968.698465:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:3.0:1789135968.698475:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+49:10769:x1876044696049152:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135968.698546:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698564:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698576:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698603:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698610:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698617:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698623:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135968.698627:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698635:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135968.698649:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135968.698655:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.698671:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.699000:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+49:10769:x1876044696049152:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 525us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.699008:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:2.0:1789135968.703176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135968.703298:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696049408 00000100:00100000:0.0:1789135968.703307:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696049408 00000100:00100000:0.0:1789135968.703367:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:0.0:1789135968.703377:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+49:10769:x1876044696049408:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:0.0:1789135968.703641:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:10769:x1876044696049408:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 264us (476us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789135968.703649:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:0.0:1789135968.792974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.793138:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696049664 00000100:00100000:3.0:1789135968.793149:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696049664 00000100:00100000:3.0:1789135968.793241:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 104 00000100:00100000:3.0:1789135968.793251:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:10779:x1876044696049664:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135968.793275:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.793287:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135968.793316:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9673b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63008c expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793337:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135968.793342:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135968.793357:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf967c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793469:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793482:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 50 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793490:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793540:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 50 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.793555:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 50 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.793568:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723332736:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135968.795510:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135968.798223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.798374:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696049792 00000100:00100000:1.0:1789135968.798381:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696049792 00000100:00100000:2.0:1789135968.798394:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723332736:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135968.798419:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 51 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.798463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:1.0:1789135968.798474:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+51:2363:x1876044696049792:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.798490:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135968.798497:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 51 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.798510:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 51 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.799356:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.799356:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf967ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a8 expref: 51 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.799397:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789135968.799402:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.799412:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.799424:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.799456:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.799516:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:2363:x1876044696049792:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 1043us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.799524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 57 00010000:00010000:2.0:1789135968.799588:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.799606:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135968.800015:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789135968.800457:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf967c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.800475:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.800483:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135968.800485:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135968.800487:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:2.0:1789135968.800986:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:10779:x1876044696049664:12345-192.168.204.41@tcp:101:bash.0 Request processed in 7734us (8020us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789135968.800995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 104 00000100:00100000:2.0:1789135968.804680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.805174:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050048 00000100:00100000:1.0:1789135968.805185:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050048 00000100:00100000:1.0:1789135968.805299:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 105 00000100:00100000:1.0:1789135968.805309:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:10779:x1876044696050048:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:1.0:1789135968.805646:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.805666:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.805679:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135968.805776:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789135968.805802:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000de4ce89d reply state 00000000fae3c5a5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.805825:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135968.806125:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+53:10779:x1876044696050048:12345-192.168.204.41@tcp:36:bash.0 Request processed in 816us (1504us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789135968.806133:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 105 00000020:00080000:1.0:1789135968.806138:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135968.814755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.814933:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050176 00000100:00100000:3.0:1789135968.814943:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050176 00000100:00100000:3.0:1789135968.815017:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 106 00000100:00100000:3.0:1789135968.815028:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+53:10779:x1876044696050176:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135968.815052:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.815074:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf967dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300b6 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815153:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815168:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815176:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815184:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815213:0:8031:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815245:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.815259:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.815273:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723332864:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135968.815363:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.817929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.818544:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723332864:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135968.818574:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819513:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819528:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819536:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819543:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.819548:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819579:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819600:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135968.819603:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.819606:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819618:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.819624:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf967d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.819929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050304 00000100:00100000:1.0:1789135968.819940:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050304 00010000:00010000:1.0:1789135968.820062:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.820108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 58 00000100:00100000:1.0:1789135968.820234:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:2363:x1876044696050304:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.820252:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135968.820261:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820289:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820308:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf967c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300af expref: 54 pid: 5851 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820320:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789135968.820325:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820332:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820349:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.820484:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.820564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+53:2363:x1876044696050304:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 446us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.820571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 58 00010000:00010000:3.0:1789135968.823653:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.823670:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.824205:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789135968.824210:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135968.824234:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.824289:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf967dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 53 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.824334:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 52 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.824343:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135968.824346:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135968.824350:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789135968.824643:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:10779:x1876044696050176:12345-192.168.204.41@tcp:101:bash.0 Request processed in 9615us (9896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.824652:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 106 00000100:00100000:0.0:1789135968.828936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.829099:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050560 00000100:00100000:1.0:1789135968.829110:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050560 00000100:00100000:1.0:1789135968.829213:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:1.0:1789135968.829225:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:10779:x1876044696050560:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:1.0:1789135968.829530:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+53:10779:x1876044696050560:12345-192.168.204.41@tcp:35:bash.0 Request processed in 306us (605us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789135968.829539:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:1.0:1789135968.910233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.910979:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050688 00000100:00100000:3.0:1789135968.911051:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050688 00000100:00100000:3.0:1789135968.911410:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 107 00000100:00100000:3.0:1789135968.911423:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+53:10785:x1876044696050688:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.911453:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.911476:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf967ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300bd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911547:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911561:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911573:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.911636:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789135968.911652:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135968.911683:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911741:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf967ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300bd expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911758:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300bd expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.911766:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:3.0:1789135968.911769:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135968.911773:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135968.911844:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696050688:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 424us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.911852:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 107 00000100:00100000:0.0:1789135968.915863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.915966:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696050816 00000100:00100000:2.0:1789135968.915975:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696050816 00000100:00100000:2.0:1789135968.916149:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 108 00000100:00100000:2.0:1789135968.916161:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696050816:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135968.916182:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135968.916205:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf967f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300c4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916269:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916582:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916597:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916634:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916644:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916651:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916806:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916816:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916823:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135968.916862:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789135968.916867:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135968.916887:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916899:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916907:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916914:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916931:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916938:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.916942:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916951:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916965:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:2.0:1789135968.916969:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.916974:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.916981:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf967ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917011:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917019:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917025:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917032:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135968.917035:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917053:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917063:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2900) 00010000:00010000:2.0:1789135968.917066:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135968.917069:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917075:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf96806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917114:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf967f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300c4 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917129:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300c4 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.917137:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135968.917140:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135968.917142:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936400, rc 0) 00000100:00100000:2.0:1789135968.917218:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10785:x1876044696050816:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1058us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.917226:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 108 00000100:00100000:1.0:1789135968.922578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135968.922655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.922746:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051200 00000100:00100000:2.0:1789135968.922756:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051200 00000100:00100000:2.0:1789135968.922827:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789135968.922839:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:2364:x1876044696051200:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135968.922873:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135968.922899:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf9680d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300c4 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.922917:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135968.922921:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135968.922971:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:2364:x1876044696051200:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.922978:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789135968.924646:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051072 00000100:00100000:3.0:1789135968.924658:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051072 00000100:00100000:3.0:1789135968.924827:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 109 00000100:00100000:3.0:1789135968.924839:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074152d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696051072:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.924862:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.924885:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.924990:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.925015:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 55 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.925043:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.925082:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 55 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.925097:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 55 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.925112:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723332992:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135968.925271:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135968.932778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.932918:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723332992:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135968.932951:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.933040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051328 00000100:00100000:0.0:1789135968.933047:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051328 00010000:00010000:0.0:1789135968.933084:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 56 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.933121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:0.0:1789135968.933130:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:2363:x1876044696051328:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135968.933146:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135968.933153:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 56 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933185:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 56 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933208:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf967e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300b6 expref: 56 pid: 8031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933223:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135968.933227:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933236:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933244:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.933286:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135968.933345:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:2363:x1876044696051328:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 215us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.933354:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 59 00010000:00010000:3.0:1789135968.933891:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.933901:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.933921:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789135968.934099:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.934116:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.934140:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135968.934143:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789135968.934146:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789135968.934205:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074152d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10785:x1876044696051072:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 9370us (11638us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789135968.934214:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 109 00000100:00100000:1.0:1789135968.939813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135968.940010:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051584 00000100:00100000:2.0:1789135968.940022:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051584 00000100:00100000:2.0:1789135968.940095:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:2.0:1789135968.940105:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10785:x1876044696051584:12345-192.168.204.41@tcp:103:lfs.0 00010000:00010000:2.0:1789135968.940120:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135968.940147:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9677a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300a1 expref: 55 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.940166:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135968.940171:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135968.940238:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696051584:12345-192.168.204.41@tcp:103:lfs.0 Request processed in 133us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135968.940246:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:2.0:1789135968.944182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.944270:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051712 00000100:00100000:3.0:1789135968.944293:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051712 00000100:00100000:3.0:1789135968.944366:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 110 00000100:00100000:3.0:1789135968.944377:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696051712:12345-192.168.204.41@tcp:58:lfs.0 00010000:00010000:3.0:1789135968.944497:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.944515:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.944526:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135968.944776:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789135968.945040:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696051712:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 665us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.945048:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 110 00000100:00100000:0.0:1789135968.948673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135968.948848:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051840 00000100:00100000:3.0:1789135968.948858:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051840 00000100:00100000:3.0:1789135968.948965:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 111 00000100:00100000:3.0:1789135968.948977:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:10785:x1876044696051840:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.949017:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.949039:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949099:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949111:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949129:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949141:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949153:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135968.949156:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135968.949159:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.949166:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4200, rc 0) 00000100:00100000:3.0:1789135968.949234:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10785:x1876044696051840:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 259us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.949241:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 111 00000100:00100000:1.0:1789135968.975271:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723333120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135968.975359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135968.976185:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723333120 00000100:00100000:3.0:1789135968.976196:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723333120 00000100:00100000:3.0:1789135968.976321:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135968.976345:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723333120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135968.976386:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135968.978245:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044723333120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1891us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.978259:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135968.978568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723333120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135969.100894:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135969.421021:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135969.421034:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135969.421096:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789135969.421105:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135969.421353:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723333248:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135969.421627:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34900 going to sleep for 11 seconds 00000100:00100000:3.0:1789135969.430906:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723333248:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135969.434771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.434936:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696051968 00000100:00100000:0.0:1789135969.434947:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696051968 00000100:00100000:0.0:1789135969.435036:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 112 00000100:00100000:0.0:1789135969.435047:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10786:x1876044696051968:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135969.435081:0:5851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135969.435331:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10786:x1876044696051968:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 286us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.435339:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 112 00000100:00080000:3.0:1789135969.435760:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135969.449564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.449673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696052096 00000100:00100000:1.0:1789135969.449683:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696052096 00000100:00100000:1.0:1789135969.449783:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:1.0:1789135969.449794:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10786:x1876044696052096:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.449898:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.449917:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.449932:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.449995:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450003:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450010:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450033:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450042:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450049:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135969.450090:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789135969.450094:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135969.450107:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450119:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450130:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450136:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450142:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135969.450145:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450153:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450166:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:1.0:1789135969.450169:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.450174:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450180:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96837 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450193:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450199:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450205:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450210:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135969.450218:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450225:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450232:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8ba069d75300) 00010000:00010000:1.0:1789135969.450235:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.450238:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450244:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9683e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450258:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450264:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450282:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450287:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135969.450290:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450295:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450303:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789135969.450305:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.450318:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.450324:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.450415:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073984780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10786:x1876044696052096:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 Request processed in 623us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.450424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:2.0:1789135969.460940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.461561:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696052352 00000100:00100000:0.0:1789135969.461575:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696052352 00000100:00100000:0.0:1789135969.461669:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00100000:0.0:1789135969.461683:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:10786:x1876044696052352:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.461743:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.461770:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9684c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.461891:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.461911:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.461923:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135969.461933:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135969.462038:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462046:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462053:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462076:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.462081:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462089:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462102:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135969.462105:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135969.462111:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462116:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462159:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9684c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d9 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462169:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:0.0:1789135969.462172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135969.462176:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf9684c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d9 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.462187:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135969.462942:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696052352:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1258us (2009us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789135969.462953:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 114 00000100:00100000:2.0:1789135969.471262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.473026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696052480 00000100:00100000:1.0:1789135969.473046:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696052480 00000100:00100000:1.0:1789135969.473214:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 115 00000100:00100000:1.0:1789135969.473227:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696052480:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789135969.473292:0:5852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789135969.474660:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696052480:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 1424us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.474675:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 115 00000100:00100000:2.0:1789135969.485476:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.485783:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696052736 00000100:00100000:1.0:1789135969.485796:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696052736 00000100:00100000:1.0:1789135969.486018:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 116 00000100:00100000:1.0:1789135969.486031:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696052736:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.486060:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135969.486065:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135969.486101:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf967f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300bd expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.486127:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:1.0:1789135969.486133:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135969.486189:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96861 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300e0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135969.486834:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789135969.487092:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.487109:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.487122:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.487199:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96861 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e0 expref: 58 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.487220:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e0 expref: 57 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.487229:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75300) 00010000:00010000:1.0:1789135969.487232:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135969.487236:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7c00, rc 0) 00000100:00100000:1.0:1789135969.487348:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:10786:x1876044696052736:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1319us (1891us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789135969.487359:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 116 00000100:00100000:2.0:1789135969.495452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.504763:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696052992 00000100:00100000:0.0:1789135969.504976:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696052992 00000100:00100000:0.0:1789135969.505173:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 117 00000100:00100000:0.0:1789135969.505187:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:10786:x1876044696052992:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.505341:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135969.505387:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e0 expref: 57 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505421:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75300) 00010000:00010000:0.0:1789135969.505437:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135969.505472:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505492:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505503:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505518:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505525:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505531:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505639:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505648:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505663:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505670:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.505676:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505685:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505694:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789135969.505696:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135969.505725:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505733:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96876 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505745:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505752:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505757:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505762:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.505765:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505780:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505788:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4e8f7588 (ffff8ba06ca52e00) 00010000:00010000:0.0:1789135969.505791:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135969.505794:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.505799:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf9687d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4e8f7588 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.505961:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696052992:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 774us (10523us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135969.505971:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 117 00000100:00100000:3.0:1789135969.515255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.517335:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696053120 00000100:00100000:1.0:1789135969.517354:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696053120 00000100:00100000:1.0:1789135969.517601:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:1.0:1789135969.517616:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:10786:x1876044696053120:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.517674:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135969.517734:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300e7 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.517784:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.517801:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.517816:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.517974:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 58 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.518009:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 57 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.518020:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:1.0:1789135969.518023:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135969.518028:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6800, rc 0) 00000100:00100000:1.0:1789135969.518117:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:10786:x1876044696053120:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 504us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.518125:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:0.0:1789135969.525231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.525612:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696053376 00000100:00100000:1.0:1789135969.525626:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696053376 00000100:00100000:1.0:1789135969.525736:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:1.0:1789135969.525748:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:10786:x1876044696053376:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.525884:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.525905:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.525919:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135969.526383:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789135969.526465:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443400764358ns, next at 444400760010ns, rc = 0 00000004:00010000:1.0:1789135969.526585:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b0e2bd76 reply state 00000000ac337aee transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.526597:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135969.526786:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073984f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:10786:x1876044696053376:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 1037us (1568us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789135969.526797:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 119 00010000:00010000:0.0:1789135969.530617:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530641:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530649:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530657:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.530663:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530672:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530770:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.530773:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135969.530780:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.530787:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.533488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.534203:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696053504 00000100:00100000:0.0:1789135969.534217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696053504 00000100:00100000:0.0:1789135969.534321:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:0.0:1789135969.534333:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+58:10786:x1876044696053504:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.534368:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.534396:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300ee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.534478:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.534494:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.534517:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.534521:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135969.534525:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030800, rc 0) 00000100:00100000:0.0:1789135969.534619:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:10786:x1876044696053504:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 287us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.534646:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:1.0:1789135969.543490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.543613:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696053632 00000100:00100000:0.0:1789135969.543627:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696053632 00000100:00100000:0.0:1789135969.543761:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:0.0:1789135969.543779:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696053632:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.544215:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696053632:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 443us (738us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789135969.544225:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00080000:3.0:1789135969.544631:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135969.551975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.552320:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696053888 00000100:00100000:0.0:1789135969.552334:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696053888 00000100:00100000:0.0:1789135969.552422:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:0.0:1789135969.552433:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:10786:x1876044696053888:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.552794:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:10786:x1876044696053888:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 362us (839us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789135969.552804:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:2.0:1789135969.562472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.562601:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054144 00000100:00100000:1.0:1789135969.562615:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054144 00000100:00100000:1.0:1789135969.562696:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:1.0:1789135969.562760:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:10786:x1876044696054144:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789135969.562954:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:10786:x1876044696054144:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 199us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.562964:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:2.0:1789135969.569958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.570105:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054272 00000100:00100000:0.0:1789135969.570117:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054272 00000100:00100000:0.0:1789135969.570455:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 122 00000100:00100000:0.0:1789135969.570469:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:10786:x1876044696054272:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.570500:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.570532:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf968a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300f5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570631:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570674:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570688:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135969.570788:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135969.570880:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570914:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf968a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300f5 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570938:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300f5 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.570948:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.570951:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135969.570955:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030200, rc 0) 00000100:00100000:0.0:1789135969.571081:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:10786:x1876044696054272:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 615us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.571089:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 122 00000100:00100000:3.0:1789135969.574020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.574545:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054400 00000100:00100000:0.0:1789135969.574558:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054400 00000100:00100000:0.0:1789135969.574631:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:0.0:1789135969.574643:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696054400:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.574668:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.574766:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6300fc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135969.574802:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c60, blocks: 0x1 00010000:00010000:0.0:1789135969.574828:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1789135969.574834:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.574847:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.574873:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.574891:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031c00, rc 0) 00000100:00100000:0.0:1789135969.575133:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2364:x1876044696054400:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 492us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.575141:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:2.0:1789135969.579295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.579474:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054656 00000100:00100000:1.0:1789135969.579487:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054656 00000100:00100000:1.0:1789135969.579812:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:1.0:1789135969.579828:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:10786:x1876044696054656:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789135969.580287:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:10786:x1876044696054656:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 461us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.580298:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 123 00000100:00100000:2.0:1789135969.592312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.592517:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054784 00000100:00100000:0.0:1789135969.592533:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054784 00000100:00100000:0.0:1789135969.592629:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:0.0:1789135969.592642:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07257f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:10786:x1876044696054784:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.592674:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.593428:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630103 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.593484:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.593521:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.593527:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.593534:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 11 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.593587:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.593607:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.593624:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8442:1876044723333376:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135969.593795:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042f286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.597478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.597643:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8442:1876044723333376:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135969.597748:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 11 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.597781:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031200, rc 0) 00000100:00100000:0.0:1789135969.597889:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07257f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:10786:x1876044696054784:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 5249us (5596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.597902:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:3.0:1789135969.599422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696054912 00000100:00100000:3.0:1789135969.599438:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696054912 00010000:00010000:3.0:1789135969.599499:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.599551:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:3.0:1789135969.599563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2364:x1876044696054912:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.599584:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.599616:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.599655:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.599690:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055896b1e/0x38eb79866bf968ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300fc expref: 11 pid: 6700 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.599969:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135969.599975:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135969.600059:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.600071:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.600136:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 10 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.600604:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723333504:192.168.204.41@tcp:105: 00000100:00100000:3.0:1789135969.600788:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.605557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.605695:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055040 00000100:00100000:0.0:1789135969.605740:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055040 00002000:00100000:0.0:1789135969.605822:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ba0741ccf00 x1876044696055040/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:400/0 lens 504/0 e 0 to 0 dl 1789135980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135969.605854:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba0741ccf00 with x1876044696055040 ext(0->12) 00002000:00010000:0.0:1789135969.605862:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba0741ccf00 00000100:00100000:0.0:1789135969.605895:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:0.0:1789135969.605905:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2363:x1876044696055040:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.606550:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696055040:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 Request processed in 642us (1003us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789135969.606561:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00002000:00100000:0.0:1789135969.606570:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ba0741ccf00 x1876044696055040/t4294967308(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:400/0 lens 504/448 e 0 to 0 dl 1789135980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135969.606580:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba0741ccf00 with x1876044696055040 ext(0->12) 00002000:00010000:0.0:1789135969.606584:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba0741ccf00 00000100:00100000:3.0:1789135969.606922:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723333504:192.168.204.41@tcp:105: 00010000:00010000:3.0:1789135969.606954:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135969.606992:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:2364:x1876044696054912:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 7431us (9530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.607003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:2.0:1789135969.610874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135969.610995:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055168 00000100:00100000:3.0:1789135969.611008:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055168 00000100:00100000:3.0:1789135969.611089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00100000:3.0:1789135969.611101:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:10786:x1876044696055168:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789135969.698988:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789135969.699034:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789135969.699069:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba0448e6780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789135969.699075:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba044bceb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba06ca6ff00 00000020:00080000:1.0:1789135969.699078:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba044bce700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b9f45955400 00000004:00080000:1.0:1789135969.699107:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1789135969.699143:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789135969.699218:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba058d35540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789135969.699222:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e79300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba058d35300 00000020:00080000:1.0:1789135969.699225:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e79500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba073f1bc00 00000020:00080000:1.0:1789135969.699241:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789135969.699533:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789135969.699734:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723333632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789135969.699831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.699923:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723333760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135969.699949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.699990:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723333632 00000100:00100000:1.0:1789135969.699999:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723333632 00000100:00100000:1.0:1789135969.700058:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723333760 00000100:00100000:1.0:1789135969.700061:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723333760 00000100:00100000:1.0:1789135969.700106:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135969.700116:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723333632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789135969.700153:0:6700:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1789135969.700188:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.700216:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.700228:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789135969.700232:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135969.700238:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.700283:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.700300:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 11 pid: 6697 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.700313:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876044723333888:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135969.700388:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135969.700407:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135969.700415:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723333760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789135969.700585:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789135969.700589:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135968 00002000:00010000:1.0:1789135969.700597:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135969.700600:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789135968 -> 1789135968 00002000:00010000:1.0:1789135969.700602:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789135969.700649:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1876044723333760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (698us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789135969.700657:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1789135969.700873:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba05c09b840/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789135969.700881:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723333760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135969.702169:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0732e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723334016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789135969.703789:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.704460:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10786:x1876044696055168:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 Request processed in 93355us (93599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.704475:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00100000:2.0:1789135969.704918:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723334016 00000100:00100000:2.0:1789135969.704931:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723334016 00000100:00100000:2.0:1789135969.704998:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135969.705011:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723334016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789135969.705051:0:6698:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1789135969.705102:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40c5f, atime: 0x6aa40c5f, ctime: 0x6aa40c5f, blocks: 0x1 00010000:00010000:2.0:1789135969.705112:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.705133:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1789135969.705139:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135969.705155:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.705183:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.705432:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.705460:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.705480:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135969.706368:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135969.706378:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.706459:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789135969.706464:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.706475:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.706502:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.706511:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c180c82/0x38eb79866bf968c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.706540:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135969.706542:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135969.706544:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135969.707613:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876044723333888:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135969.707653:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.708666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135969.709363:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055296 00000100:00100000:3.0:1789135969.709375:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055296 00000100:00100000:2.0:1789135969.710131:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876044723334016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5110us (6340us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789135969.710145:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789135969.710590:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 12 pid: 6697 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.710639:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:3.0:1789135969.710649:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:2364:x1876044696055296:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.710668:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.710675:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 12 pid: 6697 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.710690:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 12 pid: 6697 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.710736:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c61fca0e/0x38eb79866bf9667e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630062 expref: 12 pid: 6697 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.710757:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.710762:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.710769:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.710779:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.710809:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135969.710863:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2364:x1876044696055296:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 215us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.710893:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 61 00000004:00080000:1.0:1789135969.711825:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba0732e0b40/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789135969.711836:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0732e0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723334016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789135969.711865:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.711880:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.711893:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.711921:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.711956:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135969.712457:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135969.712466:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.712474:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135969.712479:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.712489:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.712507:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.712515:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec31e206/0x38eb79866bf968bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.712539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135969.712550:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135969.712552:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135969.713514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.714764:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1876044723333632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14643us (14927us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789135969.714777:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135969.714811:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055424 00000100:00100000:1.0:1789135969.714820:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055424 00000100:00100000:1.0:1789135969.714871:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:1.0:1789135969.714881:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2365:x1876044696055424:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789135969.725486:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba05c09b480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789135969.725503:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723333632:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789135969.785900:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789135969.785934:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1789135969.786077:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2365:x1876044696055424:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 Request processed in 71188us (72560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.786094:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:2.0:1789135969.792607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.793353:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055680 00000100:00100000:0.0:1789135969.793367:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055680 00000100:00100000:0.0:1789135969.793564:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 125 00000100:00100000:0.0:1789135969.793577:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10786:x1876044696055680:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.793652:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135969.793688:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300f5 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.793740:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.793747:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135969.794477:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.794498:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.794510:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135969.794984:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003f9a92d8 reply state 00000000bf4fe872 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.794995:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135969.795301:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:10786:x1876044696055680:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 1723us (2707us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789135969.795312:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 125 00000100:00100000:3.0:1789135969.810142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.810783:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696055808 00000100:00100000:0.0:1789135969.810798:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696055808 00000100:00100000:0.0:1789135969.810870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:0.0:1789135969.810882:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696055808:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135969.811246:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789135969.811251:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789135968 -> 1789135967 00002000:00010000:0.0:1789135969.811254:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789135967 00002000:00010000:0.0:1789135969.811256:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789135968 -> 1789135967 00002000:00010000:0.0:1789135969.811268:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789135969.811345:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696055808:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 465us (1219us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789135969.811353:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 44 00010000:00010000:2.0:1789135969.811596:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811608:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811616:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811623:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135969.811630:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811638:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811658:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:2.0:1789135969.811661:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135969.811668:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.811674:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf968ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.818271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135969.818509:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056064 00000100:00100000:0.0:1789135969.818541:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056064 00000100:00100000:0.0:1789135969.818668:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 126 00000100:00100000:0.0:1789135969.818679:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:10786:x1876044696056064:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.818798:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.818820:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 15 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.818831:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.818878:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 15 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.818909:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 15 pid: 8031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.818927:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723334144:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135969.819066:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.823729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.824020:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056192 00000100:00100000:1.0:1789135969.824034:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056192 00010000:00010000:1.0:1789135969.824098:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 16 pid: 8031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.824155:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:1.0:1789135969.824167:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2363:x1876044696056192:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135969.824186:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135969.824195:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 16 pid: 8031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.824237:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 16 pid: 8031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.824278:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:1.0:1789135969.824284:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.824295:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.824304:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.824329:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135969.824416:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073985680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2363:x1876044696056192:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 250us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.824426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 62 00010000:00010000:2.0:1789135969.826648:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf9688b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300e7 expref: 15 pid: 8031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.826685:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723334144:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135969.826902:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827122:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827130:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827170:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827190:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827199:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827205:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.827210:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827219:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827240:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.827243:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789135969.827249:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.827256:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf968d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.827402:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10786:x1876044696056064:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 Request processed in 8722us (9156us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789135969.827413:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 126 00000100:00100000:0.0:1789135969.831379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.831475:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056320 00000100:00100000:1.0:1789135969.831488:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056320 00000100:00100000:1.0:1789135969.831571:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:1.0:1789135969.831583:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073984b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696056320:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.831653:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.831679:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.831880:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135969.831886:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135969.831892:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.831941:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.832027:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 7 pid: 8442 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.832049:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723334272:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135969.832271:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.836356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.836495:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723334272:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135969.836534:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.836791:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056448 00000100:00100000:3.0:1789135969.836800:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056448 00010000:00010000:3.0:1789135969.836850:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 8 pid: 8442 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.836959:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:3.0:1789135969.836971:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696056448:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.836994:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.837028:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 8 pid: 8442 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.837043:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 8 pid: 8442 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.837074:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000999ae87d/0x38eb79866bf968b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630103 expref: 8 pid: 8442 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.837099:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.837104:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.837112:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.837911:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.838948:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135969.839106:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696056448:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2127us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.839134:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 63 00010000:00010000:1.0:1789135969.839134:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839409:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839457:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839482:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839492:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839500:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135969.839506:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839518:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839540:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.839548:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002862cead/0x38eb79866bf968d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.839612:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073984b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696056320:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 Request processed in 8032us (8248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.839622:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789135969.842964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.843219:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056704 00000100:00100000:1.0:1789135969.843233:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056704 00000100:00100000:1.0:1789135969.843321:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 127 00000100:00100000:1.0:1789135969.843357:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073985e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10786:x1876044696056704:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.843474:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.843496:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.843511:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.845066:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.845090:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.845100:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.845149:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.845167:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 15 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.845188:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723334400:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135969.845322:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.852504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135969.852642:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056832 00000100:00100000:2.0:1789135969.852656:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056832 00010000:00010000:2.0:1789135969.852748:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 16 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.852799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00100000:2.0:1789135969.852812:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2363:x1876044696056832:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135969.852836:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135969.852844:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 16 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.852861:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 16 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.852894:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:2.0:1789135969.852900:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.852911:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.852944:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.852973:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135969.853051:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:2363:x1876044696056832:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 241us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.853061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 64 00010000:00010000:1.0:1789135969.853874:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300ee expref: 15 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.853917:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723334400:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135969.853960:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.853970:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.853985:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135969.854435:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789135969.854641:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789135969.854694:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789135969.856493:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723334528:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789135969.856631:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.856695:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.858290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723334528 00000100:00100000:2.0:1789135969.858306:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723334528 00000100:00100000:2.0:1789135969.858392:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135969.858404:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8031:x1876044723334528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135969.858562:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8031:x1876044723334528:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.858572:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135969.859584:0:8031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789135969.859596:0:8031:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1789135969.859624:0:8031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba05c09b840, transno 4294967309 00000004:00080000:1.0:1789135969.859647:0:8031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba05c09b480, transno 4294967310 00000100:00100000:1.0:1789135969.859657:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723334528:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789135969.860620:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789135969.860824:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723334656:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789135969.860912:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.860967:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.861066:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723334656 00000100:00100000:0.0:1789135969.861080:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723334656 00000100:00100000:0.0:1789135969.861165:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135969.861178:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8031:x1876044723334656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135969.861465:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8031:x1876044723334656:12345-0@lo:1000:mdt00_003.0 Request processed in 282us (546us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789135969.861475:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135969.862452:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723334656:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789135969.862573:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862587:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862596:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862604:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.862610:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862620:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862642:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75900) 00010000:00010000:0.0:1789135969.862646:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135969.862651:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862659:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf968e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862736:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862756:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862763:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862769:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.862773:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862780:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862790:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135969.862792:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135969.862801:0:8031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862815:0:8031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862827:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.862867:0:8031:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.862881:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723334784:192.168.204.41@tcp:105: 00000100:00100000:0.0:1789135969.862997:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058d34300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.879145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135969.879285:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696056960 00000100:00100000:2.0:1789135969.879298:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696056960 00000100:00100000:2.0:1789135969.879385:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 31 00000100:00100000:3.0:1789135969.879391:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723334784:192.168.204.41@tcp:105: 00000100:00100000:2.0:1789135969.879402:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10785:x1876044696056960:12345-192.168.204.41@tcp:49:lfs.0 00010000:00010000:3.0:1789135969.879434:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879448:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96829 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879493:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879513:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879529:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879540:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879547:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879555:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879562:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135969.879568:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.879596:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10785:x1876044696056960:12345-192.168.204.41@tcp:49:lfs.0 Request processed in 198us (467us total) trans 0 rc 0/0 00010000:00010000:3.0:1789135969.879598:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.879610:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 31 00010000:00010000:3.0:1789135969.879619:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135969.879624:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135969.879629:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879634:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf968ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879647:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879652:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879658:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879662:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135969.879665:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879670:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879678:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135969.879680:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135969.879682:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.879757:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf968df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.881886:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073985e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10786:x1876044696056704:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 38520us (38981us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789135969.881904:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 127 00000020:00080000:0.0:1789135969.881913:0:8031:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789135969.887185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135969.887378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696057216 00000100:00100000:3.0:1789135969.887402:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696057216 00000100:00100000:3.0:1789135969.887486:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 128 00000100:00100000:3.0:1789135969.887500:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:10785:x1876044696057216:12345-192.168.204.41@tcp:58:lfs.0 00000100:00100000:2.0:1789135969.887562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.887772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696057472 00000100:00100000:1.0:1789135969.887777:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696057472 00000100:00100000:1.0:1789135969.887810:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:1.0:1789135969.887817:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:10786:x1876044696057472:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789135969.888502:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789135969.888629:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000040:00080000:3.0:1789135969.888632:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:1.0:1789135969.888683:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888726:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888741:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888751:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888758:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.888764:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10785:x1876044696057216:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 1266us (1599us total) trans 0 rc 0/0 00010000:00010000:1.0:1789135969.888766:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.888774:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 128 00010000:00010000:1.0:1789135969.888784:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135969.888842:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10786:x1876044696057472:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 1024us (1280us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789135969.888850:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 32 00000020:00080000:1.0:1789135969.888854:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135969.888908:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135969.888926:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888933:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789135969.888938:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888947:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888964:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ba069d75600) 00010000:00010000:1.0:1789135969.888968:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789135969.888974:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.888980:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf968f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.889002:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.889003:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.889005:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135969.935170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135969.935324:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696057600 00000100:00100000:2.0:1789135969.935336:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696057600 00000100:00100000:2.0:1789135969.935412:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 129 00000100:00100000:2.0:1789135969.935425:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073987840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:10789:x1876044696057600:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135969.935487:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135969.935519:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf968fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63010a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935614:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935634:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935647:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935667:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935674:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.935680:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.936108:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.936120:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.936130:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.936186:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.936211:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 21 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.936229:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723334912:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135969.936368:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135969.943776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.944209:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696057856 00000100:00100000:1.0:1789135969.944226:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696057856 00000100:00100000:1.0:1789135969.944329:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:1.0:1789135969.944342:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:5608:x1876044696057856:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135969.944787:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:5608:x1876044696057856:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 447us (1020us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789135969.944796:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:2.0:1789135969.945819:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723334912:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135969.945860:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.948899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135969.949155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696057984 00000100:00100000:1.0:1789135969.949166:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696057984 00010000:00010000:1.0:1789135969.949237:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 23 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.949291:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:1.0:1789135969.949301:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2364:x1876044696057984:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135969.949317:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135969.949333:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 23 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949352:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 23 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949381:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9681b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300cb expref: 23 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949402:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789135969.949410:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949421:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949430:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.949461:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135969.949526:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:2364:x1876044696057984:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 226us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.949538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00010000:00010000:0.0:1789135969.949549:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949567:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135969.949635:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789135969.949642:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135969.949671:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949692:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949740:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949749:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949757:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949765:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.949787:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949797:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949824:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789135969.949829:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135969.949835:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949843:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949862:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949868:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949875:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949880:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135969.949883:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949888:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949896:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ba05c1c2100) 00010000:00010000:0.0:1789135969.949898:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135969.949909:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949916:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.949995:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf968fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63010a expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.950014:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63010a expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.950021:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135969.950024:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135969.950026:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936600, rc 0) 00000100:00100000:0.0:1789135969.950092:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073987840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10789:x1876044696057600:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 14668us (14951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.950101:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 129 00010000:00010000:2.0:1789135970.124911:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135970.896248:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135970.896257:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135970.896296:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789135970.896303:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135970.897754:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723335040:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135970.898624:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ad80 going to sleep for 11 seconds 00000040:00080000:3.0:1789135970.910969:0:12525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135970.910981:0:12525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135970.911037:0:12525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789135970.911043:0:12525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135970.916750:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c1a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723335040:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135970.922894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135970.923679:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696058112 00000100:00100000:0.0:1789135970.923691:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696058112 00000100:00100000:0.0:1789135970.923797:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 130 00000100:00100000:0.0:1789135970.923808:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10800:x1876044696058112:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135970.923847:0:5850:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135970.924263:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10800:x1876044696058112:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 455us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135970.924272:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 130 00000100:00100000:2.0:1789135970.944101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135970.946061:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696058368 00000100:00100000:3.0:1789135970.946075:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696058368 00000100:00100000:3.0:1789135970.946138:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 131 00000100:00100000:3.0:1789135970.946148:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:10800:x1876044696058368:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135970.946182:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135970.946204:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630111 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.946316:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9691e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.946332:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9691e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.946345:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9691e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135970.946357:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789135970.946489:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5a00/0x38eb79866bf96917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630111 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.946506:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9691e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630111 expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.946515:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135970.946518:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135970.946521:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135970.946598:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10800:x1876044696058368:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 451us (2506us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789135970.946606:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 131 00000100:00100000:0.0:1789135970.964995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135970.965045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135970.965498:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696058496 00000100:00100000:2.0:1789135970.965511:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696058496 00000100:00100000:2.0:1789135970.965578:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:2.0:1789135970.965589:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073986d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2364:x1876044696058496:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135970.965609:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135970.965636:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf9691e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630111 expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.965657:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135970.965662:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135970.965743:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073986d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:2364:x1876044696058496:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 155us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135970.965752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:3.0:1789135970.968165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696058752 00000100:00100000:3.0:1789135970.968178:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696058752 00000100:00100000:2.0:1789135970.970175:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 132 00000100:00100000:2.0:1789135970.970200:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073986580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:10800:x1876044696058752:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789135970.970315:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.970335:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.970350:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971288:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971301:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971308:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971314:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135970.971319:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971327:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971339:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:2.0:1789135970.971342:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135970.971347:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135970.971370:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf9692c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135970.972141:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073986580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10800:x1876044696058752:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 1945us (7087us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789135970.972153:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 132 00000040:00080000:1.0:1789135970.973327:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135970.973335:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135970.974274:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789135970.974287:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135970.986788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135970.989185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059008 00000100:00100000:1.0:1789135970.989199:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059008 00000100:00100000:1.0:1789135970.989270:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:1.0:1789135970.989280:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:10800:x1876044696059008:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789135970.989527:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10800:x1876044696059008:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 248us (2749us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789135970.989535:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00010000:00010000:1.0:1789135971.148858:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135972.123050:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789135972.123070:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789135972.123075:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1789135972.179818:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135973.109373:0:12577:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135973.109382:0:12577:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135973.109431:0:12577:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789135973.109437:0:12577:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789135973.196942:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135973.248127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.248170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.248209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.248236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.248264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.248297:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059648 00000100:00100000:3.0:1789135973.248309:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059648 00000100:00100000:3.0:1789135973.248368:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059264 00000100:00100000:3.0:1789135973.248371:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059264 00000100:00100000:3.0:1789135973.248393:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 165 00000100:00100000:3.0:1789135973.248401:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696059648:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135973.248473:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696059648:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.248479:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 165 00000100:00100000:3.0:1789135973.248497:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:3.0:1789135973.248504:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2363:x1876044696059264:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135973.248532:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2363:x1876044696059264:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.248539:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:3.0:1789135973.248556:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059392 00000100:00100000:3.0:1789135973.248560:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059392 00000100:00100000:3.0:1789135973.248583:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059520 00000100:00100000:3.0:1789135973.248586:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059520 00000100:00100000:3.0:1789135973.248613:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:3.0:1789135973.248620:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696059392:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135973.248646:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696059392:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.248669:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:3.0:1789135973.248681:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:3.0:1789135973.248687:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696059520:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135973.248765:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696059520:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 77us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.248771:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00080000:3.0:1789135973.248788:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135973.248792:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135973.248795:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135973.249062:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059136 00000100:00100000:0.0:1789135973.249067:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059136 00000100:00100000:0.0:1789135973.249227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 326 00000100:00100000:0.0:1789135973.249236:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696059136:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135973.249273:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696059136:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 39us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135973.249279:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 326 00000100:00100000:3.0:1789135973.374109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135973.374202:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696059904 00000100:00100000:0.0:1789135973.374211:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696059904 00000100:00100000:0.0:1789135973.374280:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 133 00000100:00100000:0.0:1789135973.374290:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:10821:x1876044696059904:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789135973.374324:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135973.374347:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630118 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135973.374449:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9693a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135973.374465:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9693a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135973.374479:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9693a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135973.374511:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135973.374656:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf96933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630118 expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135973.374678:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9693a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630118 expref: 26 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135973.374687:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789135973.374690:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789135973.374694:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030600, rc 0) 00000100:00100000:0.0:1789135973.374810:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10821:x1876044696059904:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 522us (711us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789135973.374819:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 133 00000100:00100000:0.0:1789135973.393041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.394012:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060032 00000100:00100000:3.0:1789135973.394026:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060032 00000100:00100000:3.0:1789135973.394094:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 134 00000100:00100000:3.0:1789135973.394104:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10821:x1876044696060032:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135973.394179:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394209:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394223:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394252:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394259:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394281:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394287:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135973.394292:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394300:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394313:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:3.0:1789135973.394316:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135973.394321:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.394328:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135973.394407:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073985a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:10821:x1876044696060032:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 303us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.394415:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 134 00000100:00100000:1.0:1789135973.515833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135973.515938:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060160 00000100:00100000:3.0:1789135973.515948:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060160 00000100:00100000:3.0:1789135973.516013:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:3.0:1789135973.516024:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696060160:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:3.0:1789135973.516044:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135973.516066:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf9694f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63011f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135973.516114:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40c5f, atime: 0x6aa40c5f, ctime: 0x6aa40c5f, blocks: 0xb 00010000:00010000:3.0:1789135973.516136:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=447s v=(0 0) 00010000:00010000:3.0:1789135973.516140:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135973.516155:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf9694f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63011f expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.516175:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf9694f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63011f expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135973.516197:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5a00, rc 0) 00000100:00100000:3.0:1789135973.516256:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696060160:12345-192.168.204.41@tcp:101:cat.0 Request processed in 233us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135973.516264:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:3.0:1789135973.529069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135973.533919:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060288 00000100:00100000:0.0:1789135973.533935:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060288 00002000:00100000:0.0:1789135973.534000:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ba085f10f00 x1876044696060288/t0(0) o3->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:404/0 lens 488/0 e 0 to 0 dl 1789135984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135973.534012:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f10f00 with x1876044696060288 ext(0->4095) 00002000:00010000:0.0:1789135973.534019:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f10f00 00000100:00100000:0.0:1789135973.534059:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:0.0:1789135973.534068:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696060288:12345-192.168.204.41@tcp:3:cat.0 00000100:00100000:0.0:1789135973.534743:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696060288:12345-192.168.204.41@tcp:3:cat.0 Request processed in 673us (5681us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789135973.534753:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00002000:00100000:0.0:1789135973.534780:0:6704:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ba085f10f00 x1876044696060288/t0(0) o3->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:404/0 lens 488/4536 e 0 to 0 dl 1789135984 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135973.534789:0:6704:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f10f00 with x1876044696060288 ext(0->4095) 00002000:00010000:0.0:1789135973.534793:0:6704:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f10f00 00000100:00100000:2.0:1789135973.582494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723335424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135973.582568:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135973.582638:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135973.582644:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723335552:0@lo:400:kworker.0 00000100:00100000:2.0:1789135973.582672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135973.582724:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335552 00000100:00100000:2.0:1789135973.582731:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335552 00000100:00100000:2.0:1789135973.582786:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135973.582795:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723335552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135973.582848:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723335552:12345-0@lo:400:kworker.0 Request processed in 54us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135973.582856:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789135973.582876:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135973.582902:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723335552:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.582976:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723335168:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135973.583046:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723335680:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135973.583091:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789135973.583097:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723335296:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135973.583136:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723335808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135973.583185:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335808 00000100:00100000:1.0:1789135973.583199:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335808 00000100:00100000:1.0:1789135973.583232:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135973.583238:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583290:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723335808:12345-0@lo:400:kworker.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135973.583297:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135973.583315:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335424 00000100:00100000:1.0:1789135973.583319:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335424 00000100:00100000:1.0:1789135973.583346:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335680 00000100:00100000:1.0:1789135973.583348:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335680 00000100:00100000:1.0:1789135973.583361:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335296 00000100:00100000:1.0:1789135973.583363:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335296 00000100:00100000:1.0:1789135973.583375:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789135973.583381:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723335424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583418:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723335424:12345-0@lo:400:kworker.0 Request processed in 37us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135973.583424:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789135973.583436:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789135973.583442:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723335680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583468:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723335680:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135973.583474:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789135973.583485:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789135973.583491:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723335296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583516:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723335296:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135973.583521:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1789135973.583540:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135973.583543:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135973.583563:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723335296:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583580:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789135973.583585:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789135973.583600:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba0732e0b40, transno 4294967304 00000100:00100000:1.0:1789135973.583612:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723335808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583623:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723335680:0@lo:400:kworker.0 00000100:00100000:1.0:1789135973.583885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723335424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135973.583993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335168 00000100:00100000:2.0:1789135973.583997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335168 00000100:00100000:2.0:1789135973.584032:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789135973.584038:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723335168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135973.584078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723335168:12345-0@lo:400:kworker.0 Request processed in 40us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135973.584084:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789135973.590082:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723335168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135973.590878:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135973.590897:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723335936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135973.590969:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135973.591197:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723335936 00000100:00100000:0.0:1789135973.591205:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723335936 00000100:00100000:0.0:1789135973.591260:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789135973.591270:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723335936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135973.591305:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135973.591360:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723335936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135973.591368:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135973.591449:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723335936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135974.093124:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723336064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135974.093226:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.094261:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336064 00000100:00100000:0.0:1789135974.094272:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336064 00000100:00100000:0.0:1789135974.094344:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789135974.094355:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723336064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135974.095135:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135974.095251:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723336064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 896us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.095259:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135974.095536:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723336064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135974.221883:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135975.252122:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789135975.252751:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1789135975.252764:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789135975.274696:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789135975.274768:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba051287900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789135975.274774:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba043bf1100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba0581a16c0 00000020:00080000:3.0:1789135975.274778:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba043bf1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba073f4ac00 00000020:00080000:3.0:1789135975.274800:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789135975.276054:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789135975.276570:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:2.0:1789135976.078555:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135976.078568:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135976.078957:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789135976.078967:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789135976.278061:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135977.307169:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135978.324509:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135978.369594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135978.369643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135978.369674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135978.369730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135978.369787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135978.369924:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060672 00000100:00100000:2.0:1789135978.369936:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060672 00000100:00100000:2.0:1789135978.370017:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060800 00000100:00100000:2.0:1789135978.370021:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060800 00000100:00100000:2.0:1789135978.370056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:2.0:1789135978.370067:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696060672:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135978.370152:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696060672:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 87us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135978.370159:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:2.0:1789135978.370177:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:2.0:1789135978.370183:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696060800:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135978.370207:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696060800:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135978.370213:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:1.0:1789135978.370249:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060928 00000100:00100000:1.0:1789135978.370254:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060928 00000100:00100000:1.0:1789135978.370284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060544 00000100:00100000:1.0:1789135978.370288:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060544 00000100:00100000:1.0:1789135978.370311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 170 00000100:00100000:1.0:1789135978.370318:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696060928:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135978.370367:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696060928:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 49us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135978.370374:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 170 00000100:00100000:1.0:1789135978.370393:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:1.0:1789135978.370400:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696060544:12345-192.168.204.41@tcp:400:kworker.0 00000100:00080000:0.0:1789135978.370410:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135978.370415:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135978.370417:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135978.370423:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696060544:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135978.370438:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:3.0:1789135978.371349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696060416 00000100:00100000:3.0:1789135978.371356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696060416 00000100:00100000:3.0:1789135978.371401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 328 00000100:00100000:3.0:1789135978.371409:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696060416:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135978.371450:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696060416:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 41us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135978.371456:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 328 00000100:00100000:3.0:1789135978.701603:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135978.701627:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0412aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135978.701714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135978.701835:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336192 00000100:00100000:0.0:1789135978.701844:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336192 00000100:00100000:0.0:1789135978.701913:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789135978.701925:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723336192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135978.701960:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135978.702004:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723336192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135978.702010:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789135978.702144:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135978.702181:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0412aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135978.702408:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723336576:0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.702445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135978.702467:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135978.702488:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723336448:0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.702514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135978.702542:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336576 00000100:00100000:2.0:1789135978.702546:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336576 00000100:00100000:2.0:1789135978.702578:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336448 00000100:00100000:2.0:1789135978.702581:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336448 00000100:00100000:2.0:1789135978.702597:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789135978.702604:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723336576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.702643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723336576:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135978.702651:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789135978.702667:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789135978.702673:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723336448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.702732:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723336448:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135978.702739:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1789135978.702754:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135978.702772:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723336448:0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.702782:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723336576:0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.702907:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723336320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.702944:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135978.702979:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723336832:0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.703005:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135978.703040:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135978.703046:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723336704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.703071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135978.703109:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336704 00000100:00100000:3.0:1789135978.703121:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336704 00000100:00100000:3.0:1789135978.703157:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135978.703164:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723336704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.703201:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723336704:12345-0@lo:400:kworker.0 Request processed in 38us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135978.703207:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135978.703247:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789135978.703253:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789135978.703269:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723336704:0@lo:400:kworker.0 00000100:00100000:0.0:1789135978.703453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336832 00000100:00100000:0.0:1789135978.703458:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336832 00000100:00100000:0.0:1789135978.703481:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789135978.703487:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723336832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135978.703534:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723336832:12345-0@lo:400:kworker.0 Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135978.703541:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789135978.703930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336320 00000100:00100000:2.0:1789135978.703935:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336320 00000100:00100000:2.0:1789135978.703970:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789135978.703977:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723336320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135978.704026:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723336320:12345-0@lo:400:kworker.0 Request processed in 45us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135978.704033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:2.0:1789135978.704064:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135978.704068:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135978.704499:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723336320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135978.704513:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073986940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723336832:0@lo:400:kworker.0 00000100:00100000:0.0:1789135979.213994:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723336960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135979.214102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135979.214679:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723336960 00000100:00100000:2.0:1789135979.214689:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723336960 00000100:00100000:2.0:1789135979.215206:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789135979.215221:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723336960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135979.215271:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135979.215830:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0412aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723336960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 611us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135979.215840:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135979.219625:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0739852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723336960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135979.343313:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135980.294007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135980.294406:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061056 00000100:00100000:0.0:1789135980.294420:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061056 00000100:00100000:0.0:1789135980.294528:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 135 00000100:00100000:0.0:1789135980.294543:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10466:x1876044696061056:12345-192.168.204.41@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789135980.294690:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10466:x1876044696061056:12345-192.168.204.41@tcp:60:lhsmtool_posix.0 Request processed in 151us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135980.294747:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 135 00000100:00080000:3.0:1789135980.296035:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:3.0:1789135980.338454:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789135980.340633:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789135980.340654:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789135980.340884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135980.341593:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061312 00000100:00100000:3.0:1789135980.341607:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061312 00000100:00100000:3.0:1789135980.341685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 35 00000100:00100000:3.0:1789135980.341728:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:10466:x1876044696061312:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135980.343737:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:10466:x1876044696061312:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 2029us (2847us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789135980.343752:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 35 00010000:00010000:1.0:1789135980.369025:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135980.643282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135980.643430:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061440 00000100:00100000:1.0:1789135980.643456:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061440 00000100:00100000:1.0:1789135980.643565:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 136 00000100:00100000:1.0:1789135980.643578:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:11274:x1876044696061440:12345-192.168.204.41@tcp:101:lsof.0 00010000:00010000:1.0:1789135980.643608:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135980.643638:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630126 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.643782:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.643802:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.643817:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135980.644131:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789135980.644137:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:3.0:1789135980.644451:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1789135980.644864:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.644903:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.644944:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135980.644955:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135980.644959:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135980.644964:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6600, rc 0) 00000100:00100000:1.0:1789135980.645167:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:11274:x1876044696061440:12345-192.168.204.41@tcp:101:lsof.0 Request processed in 1581us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135980.645177:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 136 00010000:00010000:3.0:1789135981.389197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135982.413760:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135983.437484:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135983.483478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135983.483523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135983.483557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135983.483586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135983.483616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135983.483642:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061952 00000100:00100000:0.0:1789135983.483651:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061952 00000100:00100000:0.0:1789135983.483737:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061824 00000100:00100000:0.0:1789135983.483740:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061824 00000100:00100000:0.0:1789135983.483764:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:0.0:1789135983.483774:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696061952:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135983.483851:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696061952:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135983.483858:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:0.0:1789135983.483873:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:0.0:1789135983.483879:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696061824:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135983.483915:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696061824:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135983.483922:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:0.0:1789135983.483941:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061696 00000100:00100000:0.0:1789135983.483944:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061696 00000100:00100000:0.0:1789135983.483970:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062080 00000100:00100000:0.0:1789135983.483972:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062080 00000100:00100000:0.0:1789135983.484029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:0.0:1789135983.484034:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2363:x1876044696061696:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135983.484066:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2363:x1876044696061696:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135983.484072:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:0.0:1789135983.484083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00100000:0.0:1789135983.484090:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2364:x1876044696062080:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135983.484113:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2364:x1876044696062080:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135983.484118:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00080000:0.0:1789135983.484134:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135983.484139:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135983.484141:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135983.484377:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696061568 00000100:00100000:2.0:1789135983.484382:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696061568 00000100:00100000:2.0:1789135983.484417:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 330 00000100:00100000:2.0:1789135983.484424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696061568:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135983.484465:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696061568:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 42us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135983.484471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 330 00000100:00100000:3.0:1789135983.821151:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723337088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135983.821255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135983.821375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337088 00000100:00100000:2.0:1789135983.821385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337088 00000100:00100000:2.0:1789135983.821469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789135983.821481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723337088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.821922:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723337216:0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.821966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135983.822009:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135983.822016:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723337344:0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135983.822084:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073fca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723337472:0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135983.822150:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337216 00000100:00100000:1.0:1789135983.822154:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337216 00000100:00100000:1.0:1789135983.822186:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337344 00000100:00100000:1.0:1789135983.822189:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337344 00000100:00100000:1.0:1789135983.822223:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789135983.822230:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723337216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822273:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723337216:12345-0@lo:400:kworker.0 Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135983.822303:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789135983.822325:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789135983.822331:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723337344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822361:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723337344:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135983.822366:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789135983.822395:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337472 00000100:00100000:1.0:1789135983.822399:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337472 00000100:00100000:1.0:1789135983.822430:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789135983.822437:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723337472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822473:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723337472:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135983.822479:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789135983.822501:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135983.822507:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135983.822547:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073fca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723337472:0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723337344:0@lo:400:kworker.0 00000100:00100000:1.0:1789135983.822588:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723337216:0@lo:400:kworker.0 00000100:00100000:2.0:1789135983.826268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723337088:12345-0@lo:400:kworker.0 Request processed in 4774us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135983.826285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789135983.828251:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135983.828278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135983.828375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135983.828466:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337600 00000100:00100000:2.0:1789135983.828477:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337600 00000100:00100000:2.0:1789135983.828548:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135983.828559:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723337600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135983.828630:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135983.828685:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723337600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135983.828693:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789135983.828743:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135983.828797:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135983.829638:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135983.829653:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073fcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723337728:0@lo:400:kworker.0 00000100:00100000:0.0:1789135983.829731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135983.829780:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337728 00000100:00100000:0.0:1789135983.829786:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337728 00000100:00100000:0.0:1789135983.829834:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135983.829842:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723337728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135983.829887:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723337728:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135983.829895:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135983.829936:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073fcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723337728:0@lo:400:kworker.0 00000100:00080000:0.0:1789135983.829955:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135983.837295:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723337088:0@lo:400:kworker.0 00000100:00100000:0.0:1789135984.334086:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723337856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135984.334221:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135984.334978:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337856 00000100:00100000:2.0:1789135984.334998:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337856 00000100:00100000:2.0:1789135984.335075:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135984.335089:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723337856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135984.335690:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135984.335826:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723337856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 738us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.335836:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135984.336163:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073987c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723337856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135984.466042:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135984.601633:0:12780:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:13:01 (1789135981) 00000001:00080000:3.0:1789135985.445205:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1789135985.486349:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135986.317273:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135986.317289:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135986.317927:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789135986.317941:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135986.453786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135986.453979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062336 00000100:00100000:1.0:1789135986.453992:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062336 00000100:00100000:1.0:1789135986.454097:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 137 00000100:00100000:1.0:1789135986.454111:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:11539:x1876044696062336:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135986.454139:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135986.454184:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96964 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63012d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454296:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454316:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454333:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454349:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454357:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.454363:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455093:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96979 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455109:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96979 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455119:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96979 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135986.455131:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789135986.455380:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455398:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455405:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455412:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135986.455417:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455425:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455441:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:1.0:1789135986.455444:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.455451:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.455456:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf9696b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135986.456443:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135986.456853:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456868:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456875:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456882:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135986.456902:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456911:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456929:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ba069d75900) 00010000:00010000:1.0:1789135986.456932:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.456937:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.456956:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96972 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.460002:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96964 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63012d expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.460048:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96979 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63012d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.460061:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:1.0:1789135986.460065:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.460070:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789135986.465483:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11539:x1876044696062336:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 11348us (11684us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789135986.465503:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 137 00000100:00100000:3.0:1789135986.473311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135986.473388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135986.476166:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062464 00000100:00100000:0.0:1789135986.476189:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062464 00000100:00100000:0.0:1789135986.476299:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 138 00000100:00100000:0.0:1789135986.476313:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11539:x1876044696062464:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789135986.476487:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11539:x1876044696062464:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 Request processed in 176us (3799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135986.476496:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 138 00000100:00100000:2.0:1789135986.477002:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062592 00000100:00100000:2.0:1789135986.477010:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062592 00000100:00100000:2.0:1789135986.477075:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:2.0:1789135986.477084:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:2365:x1876044696062592:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135986.477100:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135986.477135:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96979 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63012d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.477161:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:2.0:1789135986.477168:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135986.477197:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2365:x1876044696062592:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 115us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135986.477204:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00010000:00010000:1.0:1789135986.509417:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135987.342418:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135987.342431:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135987.343173:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1789135987.343201:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789135987.533000:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135988.558309:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135988.609406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135988.611004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135988.611046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135988.611080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135988.611168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135988.611216:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062848 00000100:00100000:0.0:1789135988.611229:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062848 00000100:00100000:0.0:1789135988.611327:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063232 00000100:00100000:0.0:1789135988.611331:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063232 00000100:00100000:0.0:1789135988.611360:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 180 00000100:00100000:0.0:1789135988.611372:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2366:x1876044696062848:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135988.611487:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2366:x1876044696062848:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.611496:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 180 00000100:00100000:0.0:1789135988.611518:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 181 00000100:00100000:0.0:1789135988.611524:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2365:x1876044696063232:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135988.611562:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2365:x1876044696063232:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.611570:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 181 00000100:00100000:0.0:1789135988.611598:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062976 00000100:00100000:0.0:1789135988.611601:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062976 00000100:00100000:0.0:1789135988.612418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063104 00000100:00100000:0.0:1789135988.612426:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063104 00000100:00100000:0.0:1789135988.612459:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:0.0:1789135988.612471:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696062976:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789135988.612519:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696062976:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 51us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.612526:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:0.0:1789135988.612541:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:0.0:1789135988.612547:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0732e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696063104:12345-192.168.204.41@tcp:9:kworker.0 00000020:00000080:0.0:1789135988.612746:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf9634b 00000100:00080000:0.0:1789135988.612760:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f478e2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789135988.612808:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:0.0:1789135988.613217:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0732e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+2:2362:x1876044696063104:12345-192.168.204.41@tcp:9:kworker.0 Request processed in 668us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.613226:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00080000:0.0:1789135988.613263:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135988.613268:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135988.613271:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135988.618107:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135988.618893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696062720 00000100:00100000:2.0:1789135988.618918:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696062720 00000100:00100000:2.0:1789135988.619000:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 332 00000100:00100000:2.0:1789135988.619012:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696062720:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789135988.619134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2366:x1876044696062720:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 124us (9743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135988.619142:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 332 00000100:00100000:3.0:1789135988.941250:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723338240:0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.941351:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135988.941431:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135988.941438:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723338368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.941473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135988.941514:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338240 00000100:00100000:3.0:1789135988.941523:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338240 00000100:00100000:3.0:1789135988.941597:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789135988.941608:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723338240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.941672:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ec61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723338240:12345-0@lo:400:kworker.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135988.941681:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789135988.941742:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338368 00000100:00100000:3.0:1789135988.941763:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338368 00000100:00100000:0.0:1789135988.941946:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723337984:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.941989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135988.942017:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723338496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135988.942074:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135988.942080:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723338112:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135988.942117:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723338624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942137:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135988.942163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723337984 00000100:00100000:0.0:1789135988.942167:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723337984 00000100:00100000:0.0:1789135988.942200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789135988.942207:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723337984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723337984:12345-0@lo:400:kworker.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.942250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789135988.942283:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338496 00000100:00100000:0.0:1789135988.942286:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338496 00000100:00100000:0.0:1789135988.942309:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338112 00000100:00100000:0.0:1789135988.942312:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338112 00000100:00100000:0.0:1789135988.942326:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789135988.942333:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723338496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942362:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723338496:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.942376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789135988.942389:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789135988.942395:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723338112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942420:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723338112:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.942425:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789135988.942473:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723338112:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942482:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723337984:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.942490:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723338496:0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.944989:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338624 00000100:00100000:3.0:1789135988.945003:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338624 00000100:00100000:3.0:1789135988.947928:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135988.947955:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723338368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.948106:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723338368:12345-0@lo:400:kworker.0 Request processed in 163us (6631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135988.948115:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135988.948143:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789135988.948151:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.948197:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723338624:12345-0@lo:400:kworker.0 Request processed in 48us (6058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135988.948203:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789135988.948387:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f74f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723338624:0@lo:400:kworker.0 00000100:00100000:3.0:1789135988.961829:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135988.961873:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723338752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135988.961999:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135988.963494:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338752 00000100:00100000:1.0:1789135988.963507:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338752 00000100:00100000:1.0:1789135988.963575:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135988.963587:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723338752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135988.963649:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135988.963764:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074153c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723338752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135988.963840:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135988.963932:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073ce8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723338752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789135988.964044:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135988.964052:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135988.964057:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135988.964085:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723338368:0@lo:400:kworker.0 00000100:00100000:0.0:1789135988.964101:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723338240:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.458573:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135989.458600:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723338880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135989.458689:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.459760:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723338880 00000100:00100000:0.0:1789135989.459772:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723338880 00000100:00100000:0.0:1789135989.459826:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135989.459835:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723338880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135989.459873:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135989.459949:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723338880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.459956:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135989.460031:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba074150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723338880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135989.582988:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135989.673928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135989.680834:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063360 00000100:00100000:1.0:1789135989.680855:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063360 00000100:00100000:1.0:1789135989.680997:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 139 00000100:00100000:1.0:1789135989.681022:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:11581:x1876044696063360:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135989.681045:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135989.681068:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630134 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681131:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681144:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681156:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681171:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681196:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681203:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681463:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681472:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681479:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681486:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135989.681490:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681499:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681511:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135989.681514:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.681519:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681525:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf9698e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681538:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681549:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681555:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681561:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135989.681564:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681570:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681578:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ba069d75900) 00010000:00010000:1.0:1789135989.681581:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.681584:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf96995 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681638:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96987 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630134 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681649:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135989.681651:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.681655:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630134 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.681663:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6400, rc 0) 00000100:00100000:1.0:1789135989.681767:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:11581:x1876044696063360:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 750us (7852us total) trans 0 rc 301/301 00000100:00100000:1.0:1789135989.681775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 139 00000100:00100000:3.0:1789135989.712142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135989.712277:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063616 00000100:00100000:1.0:1789135989.712288:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063616 00000100:00100000:1.0:1789135989.712357:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 140 00000100:00100000:1.0:1789135989.712367:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:11581:x1876044696063616:12345-192.168.204.41@tcp:36:lfs.0 00010000:00010000:1.0:1789135989.712434:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135989.712463:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf96305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff6d expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.712481:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135989.712486:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135989.712797:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.712814:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.712823:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.712857:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.712873:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 5 pid: 8031 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.712904:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0593ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723339008:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135989.713022:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069ebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135989.721042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135989.721130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063744 00000100:00100000:2.0:1789135989.721140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063744 00010000:00010000:2.0:1789135989.721185:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 6 pid: 8031 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.721225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:2.0:1789135989.721235:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696063744:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135989.721251:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135989.721258:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 6 pid: 8031 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.721271:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 6 pid: 8031 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.721292:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:2.0:1789135989.721297:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.721306:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.721333:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.721357:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135989.721425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696063744:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 190us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.721434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 66 00010000:00010000:1.0:1789135989.727411:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf9695d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630126 expref: 5 pid: 8031 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.727434:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0593ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723339008:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135989.727457:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.729152:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.729165:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.729195:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.729208:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.729221:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135989.734199:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789135989.734219:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734231:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734238:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734253:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135989.734259:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734268:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734287:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba05c1e9400) 00010000:00010000:1.0:1789135989.734290:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.734295:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.734302:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf9699c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135989.734677:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e32237be reply state 0000000031b2ee0a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.734687:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135989.734813:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11581:x1876044696063616:12345-192.168.204.41@tcp:36:lfs.0 Request processed in 22443us (22679us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789135989.734823:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 140 00010000:00010000:1.0:1789135989.747754:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747773:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747782:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747800:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135989.747806:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747813:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747834:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ba069d75900) 00010000:00010000:1.0:1789135989.747837:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.747842:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.747848:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf969a3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.934839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135989.934966:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696063872 00000100:00100000:0.0:1789135989.934976:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696063872 00000100:00100000:0.0:1789135989.935041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 141 00000100:00100000:0.0:1789135989.935052:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:11589:x1876044696063872:12345-192.168.204.41@tcp:101:lctl.0 00010000:00010000:0.0:1789135989.935077:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135989.935102:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf969aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63013b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935184:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935198:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935209:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135989.935272:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135989.935275:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135989.935301:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935326:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf969aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63013b expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935345:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63013b expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.935372:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:0.0:1789135989.935375:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135989.935379:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030400, rc 0) 00000100:00100000:0.0:1789135989.935449:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11589:x1876044696063872:12345-192.168.204.41@tcp:101:lctl.0 Request processed in 399us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.935457:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 141 00000100:00100000:0.0:1789135990.029050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.029646:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064000 00000100:00100000:3.0:1789135990.029657:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064000 00000100:00100000:3.0:1789135990.029782:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 142 00000100:00100000:3.0:1789135990.029795:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+15:11595:x1876044696064000:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135990.029816:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.029838:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf969b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630142 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.029946:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.029962:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.029975:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.029991:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.029999:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030005:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030125:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030134:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030142:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135990.030178:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789135990.030183:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135990.030207:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030231:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030238:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030245:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030251:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135990.030255:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030263:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030276:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135990.030279:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135990.030284:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030291:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf969bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030325:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030333:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030338:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030349:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135990.030352:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030359:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030368:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ba05c1e9d00) 00010000:00010000:3.0:1789135990.030371:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135990.030374:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030380:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf969c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030415:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf969b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630142 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030431:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630142 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.030439:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135990.030441:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789135990.030444:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4000, rc 0) 00000100:00100000:3.0:1789135990.030526:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074151a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:11595:x1876044696064000:12345-192.168.204.41@tcp:101:bash.0 Request processed in 735us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.030534:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 142 00000100:00080000:0.0:1789135990.031888:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135990.033962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.034129:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064256 00000100:00100000:0.0:1789135990.034141:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064256 00000100:00100000:0.0:1789135990.034201:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 143 00000100:00100000:0.0:1789135990.034212:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+16:11595:x1876044696064256:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:0.0:1789135990.034236:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135990.034259:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf969d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630149 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034403:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034417:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034428:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034489:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034514:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.034521:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135990.035402:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789135990.035574:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035586:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035596:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035630:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035637:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035644:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035650:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.035654:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035662:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035687:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789135990.035690:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135990.035695:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035807:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf969db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135990.035824:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000022ee51ca reply state 00000000cd18e7d1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.035832:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789135990.035865:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf969d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035891:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.035899:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:0.0:1789135990.035902:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135990.035904:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040030800, rc 0) 00000100:00100000:0.0:1789135990.036091:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073985680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11595:x1876044696064256:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1879us (2136us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789135990.036100:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 143 00010000:00010000:0.0:1789135990.045100:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045126:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045155:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045161:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.045166:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045176:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045194:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba06ca52a00) 00010000:00010000:0.0:1789135990.045197:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135990.045202:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.045208:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf969e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.047402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135990.049216:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064384 00000100:00100000:1.0:1789135990.049231:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064384 00000100:00100000:1.0:1789135990.049298:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:1.0:1789135990.049307:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1876044696064384:12345-192.168.204.41@tcp:8:bash.0 00010000:00080000:1.0:1789135990.049354:0:6698:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1789135990.049389:0:6698:0:(genops.c:1385:class_connect()) connect: client ffb60b9b-a844-43c7-b566-1c6255980b3c, cookie 0x38eb79866bf969f7 00002000:00100000:1.0:1789135990.049402:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ffb60b9b-a844-43c7-b566-1c6255980b3c/ffff8b9f46218800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135990.049415:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135990.049549:0:6698:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789135990.049584:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b9f4621e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135990.050191:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2362:x1876044696064384:12345-192.168.204.41@tcp:8:bash.0 Request processed in 881us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.050215:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:2.0:1789135990.061935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.062022:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064512 00000100:00100000:3.0:1789135990.062032:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064512 00000100:00080000:0.0:1789135990.062142:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135990.062179:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:3.0:1789135990.062189:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:0:x1876044696064512:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135990.062209:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.062234:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630150 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135990.062261:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135990.062281:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1789135990.062286:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.062295:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.062314:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.062329:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135990.062393:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:0:x1876044696064512:12345-192.168.204.41@tcp:101:bash.0 Request processed in 206us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.062401:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:2.0:1789135990.070892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.070972:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064640 00000100:00100000:3.0:1789135990.070983:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064640 00000100:00100000:3.0:1789135990.071080:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789135990.071091:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:11595:x1876044696064640:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135990.071109:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.071141:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630157 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.071171:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.071180:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.071185:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.071190:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.071222:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.071236:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.071249:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a5a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876044723339136:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135990.071347:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042faf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135990.081138:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a5a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6697:1876044723339136:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135990.081178:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081200:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:3.0:1789135990.081270:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073986d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:11595:x1876044696064640:12345-192.168.204.41@tcp:101:bash.0 Request processed in 10181us (10397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.081295:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:0.0:1789135990.081438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.081651:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696064768 00000100:00100000:3.0:1789135990.081658:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696064768 00010000:00010000:3.0:1789135990.081686:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.081745:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:3.0:1789135990.081754:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696064768:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135990.081768:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135990.081789:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081802:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081826:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f608238/0x38eb79866bf969fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630150 expref: 8 pid: 8442 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081839:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.081844:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.081854:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081865:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.081922:0:6713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.081937:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a5a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6713:1876044723339264:192.168.204.41@tcp:105: 00000100:00100000:3.0:1789135990.082000:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042faf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135990.091441:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a5a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6713:1876044723339264:192.168.204.41@tcp:105: 00010000:00010000:3.0:1789135990.091467:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135990.091528:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074150000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696064768:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 9774us (10089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.091541:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:0.0:1789135990.092070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.092193:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696065024 00000100:00100000:3.0:1789135990.092200:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696065024 00000100:00100000:3.0:1789135990.092246:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:3.0:1789135990.092256:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11595:x1876044696065024:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:3.0:1789135990.092582:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11595:x1876044696065024:12345-192.168.204.41@tcp:35:bash.0 Request processed in 327us (513us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789135990.092589:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:2.0:1789135990.217939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.218222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696065280 00000100:00100000:3.0:1789135990.218232:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696065280 00000100:00100000:3.0:1789135990.218421:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 144 00000100:00100000:3.0:1789135990.218432:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11606:x1876044696065280:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135990.218461:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.218482:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63015e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135990.218630:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789135990.218799:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63015e expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.218814:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135990.218817:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135990.218828:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63015e expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.218971:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135990.219415:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073987c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11606:x1876044696065280:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 983us (1484us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789135990.219423:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 144 00000100:00100000:2.0:1789135990.223438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.223528:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696065536 00000100:00100000:3.0:1789135990.223537:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696065536 00000100:00100000:3.0:1789135990.223623:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:3.0:1789135990.223635:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11606:x1876044696065536:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135990.223938:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:11606:x1876044696065536:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 305us (509us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789135990.223946:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:0.0:1789135990.293775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135990.293896:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696065664 00000100:00100000:1.0:1789135990.293912:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696065664 00000100:00100000:1.0:1789135990.294002:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 145 00000100:00100000:1.0:1789135990.294013:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:11612:x1876044696065664:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135990.294039:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.294063:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630165 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294128:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294143:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294155:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135990.294210:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789135990.294215:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135990.294239:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630165 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294283:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630165 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.294310:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135990.294313:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135990.294317:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6600, rc 0) 00000100:00100000:1.0:1789135990.294380:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:11612:x1876044696065664:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 369us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.294387:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 145 00000100:00100000:2.0:1789135990.301958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135990.302352:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696065920 00000100:00100000:1.0:1789135990.302362:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696065920 00000100:00100000:1.0:1789135990.302466:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 146 00000100:00100000:1.0:1789135990.302477:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:11612:x1876044696065920:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135990.302501:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.302524:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63016c expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.302631:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.302652:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.302664:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135990.302676:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789135990.302834:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63016c expref: 25 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.302886:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63016c expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.302895:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:1.0:1789135990.302898:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135990.302902:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7600, rc 0) 00000100:00100000:1.0:1789135990.302967:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11612:x1876044696065920:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 492us (1021us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789135990.302974:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 146 00000100:00100000:2.0:1789135990.309310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135990.309393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.309561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066304 00000100:00100000:3.0:1789135990.309572:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066304 00000100:00100000:3.0:1789135990.309657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:3.0:1789135990.309669:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2365:x1876044696066304:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135990.309686:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135990.309763:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63016c expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.309783:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:3.0:1789135990.309787:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135990.309849:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2365:x1876044696066304:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 182us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.309857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:1.0:1789135990.310039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066176 00000100:00100000:1.0:1789135990.310044:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066176 00000100:00100000:1.0:1789135990.310083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 147 00000100:00100000:1.0:1789135990.310091:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11612:x1876044696066176:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135990.310113:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.310500:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96a3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630173 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.310632:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.310647:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.310659:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135990.310673:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789135990.310849:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96a3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630173 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.310868:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630173 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.310886:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:1.0:1789135990.310889:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789135990.310892:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7400, rc 0) 00000100:00100000:1.0:1789135990.310943:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11612:x1876044696066176:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 853us (1644us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789135990.310950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 147 00000100:00100000:2.0:1789135990.315620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.315736:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066432 00000100:00100000:0.0:1789135990.315746:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066432 00000100:00100000:0.0:1789135990.315801:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:0.0:1789135990.315811:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696066432:12345-192.168.204.41@tcp:1:lfs.0 00010000:00010000:0.0:1789135990.315880:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.315912:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.315922:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789135990.315926:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135990.315931:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.315968:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.315982:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.316010:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723339392:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135990.316102:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135990.320435:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f77840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723339392:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135990.320466:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.320897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.320987:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066560 00000100:00100000:3.0:1789135990.321054:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066560 00002000:00100000:3.0:1789135990.321103:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ba073f77840 x1876044696066560/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:421/0 lens 504/0 e 0 to 0 dl 1789136001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135990.321113:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba073f77840 with x1876044696066560 ext(0->12) 00010000:00010000:3.0:1789135990.321122:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 8 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.321136:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 8 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135990.321143:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba073f77840 00000100:00100000:3.0:1789135990.321181:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789135990.321190:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696066560:12345-192.168.204.41@tcp:4:lfs.0 00000001:00100000:0.0:1789135990.355169:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:0.0:1789135990.355179:0:7663:0:(genops.c:885:class_export_put()) final put ffff8b9f478e3000/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000001:00100000:0.0:1789135990.355209:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:3.0:1789135990.355257:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f478e3000/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0001 00000020:00000080:3.0:1789135990.355381:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f478e2000 for lustre-OST0001 00000100:00100000:2.0:1789135990.391095:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696066560:12345-192.168.204.41@tcp:4:lfs.0 Request processed in 69895us (70189us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789135990.391113:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00002000:00100000:2.0:1789135990.391136:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ba073f77840 x1876044696066560/t4294967305(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:421/0 lens 504/448 e 0 to 0 dl 1789136001 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135990.391161:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba073f77840 with x1876044696066560 ext(0->12) 00010000:00010000:2.0:1789135990.391173:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 9 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.391190:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 9 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135990.391199:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba073f77840 00000001:00080000:0.0:1789135990.391419:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1789135990.395376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.395497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066688 00000100:00100000:0.0:1789135990.395506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066688 00010000:00010000:0.0:1789135990.395547:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.395733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:0.0:1789135990.395743:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696066688:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135990.395758:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789135990.395776:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789135990.395779:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135989 00002000:00010000:0.0:1789135990.395782:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789135989 00002000:00010000:0.0:1789135990.395784:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789135989 00002000:00010000:0.0:1789135990.395786:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789135990.395792:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.395805:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.395830:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063dd011f/0x38eb79866bf96a05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630157 expref: 7 pid: 6697 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.395847:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135990.395851:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135990.395857:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.395867:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.395922:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135990.395985:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0738bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696066688:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 243us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135990.396000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 68 00010000:00010000:2.0:1789135990.396883:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396897:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396926:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396935:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396943:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396951:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135990.396965:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.396975:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.397001:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.397008:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055896b1e/0x38eb79866bf96a52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.397092:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696066432:12345-192.168.204.41@tcp:1:lfs.0 Request processed in 81280us (81480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.397102:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:2.0:1789135990.401107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.401263:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696066944 00000100:00100000:0.0:1789135990.401272:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696066944 00000100:00100000:0.0:1789135990.401423:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:0.0:1789135990.401435:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11612:x1876044696066944:12345-192.168.204.41@tcp:35:lfs.0 00000004:00010000:0.0:1789135990.401504:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630173 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135990.401797:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789135990.401845:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789135990.402585:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789135990.402652:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.402672:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.402681:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.402892:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.402909:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 29 pid: 5850 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.402934:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723339520:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135990.403198:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135990.408011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.408168:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1876044723339520:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135990.408205:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.408461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696067072 00000100:00100000:3.0:1789135990.408468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696067072 00010000:00010000:3.0:1789135990.408520:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 30 pid: 5850 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.408563:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:3.0:1789135990.408573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:2364:x1876044696067072:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135990.408587:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135990.408595:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 30 pid: 5850 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408606:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 30 pid: 5850 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408629:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf969e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630149 expref: 30 pid: 5850 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408645:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:3.0:1789135990.408650:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408659:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408666:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.408695:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135990.408784:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:2364:x1876044696067072:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 212us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.408792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 69 00010000:00010000:0.0:1789135990.408942:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.408949:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135990.409096:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789135990.409326:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789135990.409436:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723339648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135990.409492:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135990.409525:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135990.410157:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723339648 00000100:00100000:3.0:1789135990.410166:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723339648 00000100:00100000:3.0:1789135990.410239:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135990.410251:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723339648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789135990.410433:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723339648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 184us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.410441:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135990.410524:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723339648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789135990.411225:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789135990.411304:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723339776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789135990.411364:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135990.411392:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789135990.411632:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135990.412134:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723339776 00000100:00100000:3.0:1789135990.412141:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723339776 00000100:00100000:3.0:1789135990.412181:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135990.412190:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1876044723339776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789135990.412526:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1876044723339776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 336us (1161us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789135990.412534:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135990.413194:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0738bc780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1876044723339776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789135990.413274:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789135990.413519:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413532:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413554:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413561:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135990.413566:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413574:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413591:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:2.0:1789135990.413594:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789135990.413599:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.413606:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96a59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135990.413828:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789135990.413939:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789135990.413950:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464288248942ns, next at 465288246781ns, rc = 0 00000001:00080000:2.0:1789135990.413956:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789135990.414503:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:2.0:1789135990.414509:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135990.414518:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96a44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630173 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.414654:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11612:x1876044696066944:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 13219us (13554us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789135990.414677:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 38 00000020:00080000:2.0:1789135990.414683:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789135990.419513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.419605:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696067200 00000100:00100000:3.0:1789135990.419616:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696067200 00000100:00100000:3.0:1789135990.419753:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 148 00000100:00100000:3.0:1789135990.419764:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11612:x1876044696067200:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135990.419788:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.419811:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63017a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.419885:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63017a expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.419901:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63017a expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.419944:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135990.419948:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135990.419952:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135990.420245:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:11612:x1876044696067200:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 482us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.420253:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 148 00000100:00100000:0.0:1789135990.424573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.424977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696067456 00000100:00100000:3.0:1789135990.424996:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696067456 00000100:00100000:3.0:1789135990.425059:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:3.0:1789135990.425070:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:11612:x1876044696067456:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135990.425350:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11612:x1876044696067456:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 281us (786us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789135990.425359:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:1.0:1789135990.567674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.567826:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696067712 00000100:00100000:3.0:1789135990.567837:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696067712 00000100:00100000:3.0:1789135990.567904:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 149 00000100:00100000:3.0:1789135990.567915:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11622:x1876044696067712:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135990.567939:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.567961:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96a67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630181 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135990.568293:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789135990.569770:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96a67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630181 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.569807:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:3.0:1789135990.569810:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135990.569816:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630181 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.569832:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:3.0:1789135990.569908:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11622:x1876044696067712:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1994us (2243us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1789135990.569917:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 149 00000100:00100000:3.0:1789135990.576839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135990.577183:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696067840 00000100:00100000:2.0:1789135990.577195:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696067840 00000100:00100000:2.0:1789135990.577260:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 150 00000100:00100000:2.0:1789135990.577271:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11622:x1876044696067840:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:2.0:1789135990.577523:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.577541:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.577554:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.577569:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.577576:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.577657:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.579926:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.579945:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.579957:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135990.580113:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580139:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580146:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580153:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580159:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.580163:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580171:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580185:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789135990.580188:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135990.580193:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580200:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580213:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580220:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580233:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580237:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.580240:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580247:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580255:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2c00) 00010000:00010000:0.0:1789135990.580258:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135990.580261:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580266:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580282:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580287:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580293:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580298:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.580300:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580434:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580444:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:0.0:1789135990.580446:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135990.580449:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.580455:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.580608:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11622:x1876044696067840:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 3334us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135990.580618:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 150 00000100:00100000:1.0:1789135990.584537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.584680:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696068096 00000100:00100000:3.0:1789135990.584690:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696068096 00000100:00100000:3.0:1789135990.584781:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:3.0:1789135990.584791:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11622:x1876044696068096:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135990.585453:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:11622:x1876044696068096:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 659us (922us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789135990.585463:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 40 00000001:00080000:3.0:1789135990.599263:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967428 is committed 00000001:00080000:3.0:1789135990.599384:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:3.0:1789135990.599389:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789135990.599416:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba07359b780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789135990.599421:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e7e600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba07359b480 00000020:00080000:3.0:1789135990.599424:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e7e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba0731c0800 00000001:00080000:3.0:1789135990.599442:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000100:00100000:3.0:1789135990.599686:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135990.599750:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723339904:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789135990.599819:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1789135990.599827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135990.599948:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723339904 00000100:00100000:2.0:1789135990.599956:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723339904 00000020:00080000:0.0:1789135990.600130:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789135990.600397:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135990.600409:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723339904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789135990.600439:0:6698:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789135990.600486:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40c75, atime: 0x6aa40c75, ctime: 0x6aa40c75, blocks: 0xb 00010000:00010000:2.0:1789135990.600495:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.600514:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789135990.600518:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135990.600525:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.600540:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.600551:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.600558:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.600582:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135990.600936:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135990.600946:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.600957:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135990.600961:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.600970:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.600990:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.601005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca34b14d/0x38eb79866bf96a8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.601022:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135990.601025:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135990.601026:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135990.604373:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876044723339904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3958us (4540us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789135990.604387:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1789135990.604821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789135990.605047:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba0580c0780/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789135990.605056:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723339904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789135990.638600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.639304:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696068352 00000100:00100000:3.0:1789135990.639317:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696068352 00000100:00100000:3.0:1789135990.639396:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 151 00000100:00100000:3.0:1789135990.639408:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11625:x1876044696068352:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135990.639435:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.639457:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630188 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.640157:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.640175:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.640187:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.641736:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.641749:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.641761:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.644677:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.644695:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.645925:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135990.645962:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789135990.646096:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646103:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646110:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646115:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135990.646120:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646127:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646141:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135990.646144:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135990.646149:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646155:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96a98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646169:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646175:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646191:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646197:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135990.646200:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646206:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646215:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1e9400) 00010000:00010000:2.0:1789135990.646217:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135990.646220:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646225:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646282:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646298:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.646305:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135990.646308:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135990.646310:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936e00, rc 0) 00000100:00100000:2.0:1789135990.646398:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11625:x1876044696068352:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 6992us (7808us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789135990.646416:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 151 00000100:00100000:3.0:1789135990.652873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135990.652979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696068480 00000100:00100000:0.0:1789135990.652990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696068480 00000100:00100000:0.0:1789135990.653059:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 152 00000100:00100000:0.0:1789135990.653069:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11625:x1876044696068480:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:0.0:1789135990.653145:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653165:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653179:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653213:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653220:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653227:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653233:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135990.653249:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653258:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653271:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:0.0:1789135990.653274:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135990.653281:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.653288:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.653390:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11625:x1876044696068480:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 322us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135990.653398:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 152 00000100:00100000:1.0:1789135990.660402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135990.660498:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696068736 00000100:00100000:3.0:1789135990.660508:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696068736 00000100:00100000:3.0:1789135990.660572:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:3.0:1789135990.660940:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11625:x1876044696068736:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135990.662664:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:11625:x1876044696068736:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 833us (1374us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789135990.662680:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:2.0:1789135991.179571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135991.180142:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696068992 00000100:00100000:1.0:1789135991.180153:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696068992 00000100:00100000:1.0:1789135991.180220:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 153 00000100:00100000:1.0:1789135991.180230:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:11656:x1876044696068992:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:1.0:1789135991.180256:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135991.180277:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63018f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.180404:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.180421:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.180435:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.180448:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789135991.180603:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63018f expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.180624:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63018f expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.180633:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135991.180636:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135991.180640:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7c00, rc 0) 00000100:00100000:1.0:1789135991.180832:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11656:x1876044696068992:12345-192.168.204.41@tcp:101:cat.0 Request processed in 603us (1271us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789135991.180840:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 153 00000100:00100000:0.0:1789135991.190679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135991.190897:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696069376 00000100:00100000:2.0:1789135991.190907:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696069376 00000100:00100000:2.0:1789135991.190967:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:2.0:1789135991.190987:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11656:x1876044696069376:12345-192.168.204.41@tcp:35:cat.0 00000100:00100000:2.0:1789135991.191248:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11656:x1876044696069376:12345-192.168.204.41@tcp:35:cat.0 Request processed in 271us (578us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789135991.191258:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:0.0:1789135991.191805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135991.191864:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696069120 00000100:00100000:3.0:1789135991.191870:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696069120 00000100:00100000:3.0:1789135991.191915:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789135991.191923:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2366:x1876044696069120:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.191935:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.191958:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63018f expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.191986:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135991.191991:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.192017:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2366:x1876044696069120:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.192024:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:0.0:1789135991.284427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135991.284532:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696069632 00000100:00100000:3.0:1789135991.284543:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696069632 00000100:00100000:3.0:1789135991.284606:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 154 00000100:00100000:3.0:1789135991.284616:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11662:x1876044696069632:12345-192.168.204.41@tcp:101:dd.0 00010000:00010000:3.0:1789135991.284655:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135991.284658:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135991.284689:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630165 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.284751:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135991.284757:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135991.284791:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ad0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630196 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.284911:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.284927:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.284935:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.284970:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.285119:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 23 pid: 5850 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.285134:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723340032:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135991.285242:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135991.291115:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723340032:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135991.291155:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135991.291514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135991.292030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696069760 00000100:00100000:3.0:1789135991.292046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696069760 00010000:00010000:3.0:1789135991.292083:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 24 pid: 5850 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.292126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 70 00000100:00100000:3.0:1789135991.292136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2363:x1876044696069760:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.292153:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.292160:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 24 pid: 5850 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.292173:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 24 pid: 5850 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.292196:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630188 expref: 24 pid: 5850 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.292213:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135991.292218:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.292228:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.292236:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.294405:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.294490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:2363:x1876044696069760:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2349us (2972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.294518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 70 00010000:00010000:1.0:1789135991.299840:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.299869:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.299896:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789135991.300102:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ad0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300124:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300133:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135991.300136:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135991.300140:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:1.0:1789135991.300207:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11662:x1876044696069632:12345-192.168.204.41@tcp:101:dd.0 Request processed in 15591us (15791us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789135991.300216:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 154 00000100:00100000:1.0:1789135991.304282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135991.304365:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070016 00000100:00100000:0.0:1789135991.304377:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070016 00000100:00100000:0.0:1789135991.304440:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 155 00000100:00100000:0.0:1789135991.304450:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11662:x1876044696070016:12345-192.168.204.41@tcp:36:dd.0 00010000:00010000:0.0:1789135991.305154:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.305174:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.305187:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135991.305259:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789135991.305285:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000621ef38 reply state 000000006b47eedc transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135991.305294:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135991.305439:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0593a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11662:x1876044696070016:12345-192.168.204.41@tcp:36:dd.0 Request processed in 989us (1166us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789135991.305447:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 155 00000020:00080000:0.0:1789135991.305454:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135991.321228:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321247:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321254:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321260:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135991.321278:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321288:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321305:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135991.321308:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135991.321314:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.321320:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96ae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.629154:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135991.726185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135991.726300:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070144 00000100:00100000:0.0:1789135991.726311:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070144 00000100:00100000:0.0:1789135991.726376:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 156 00000100:00100000:0.0:1789135991.726387:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11676:x1876044696070144:12345-192.168.204.41@tcp:101:stat.0 00010000:00010000:0.0:1789135991.726414:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135991.726437:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63019d expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726506:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726523:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726536:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726551:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726578:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.726586:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.727222:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.727235:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.727243:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.727276:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.727292:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 26 pid: 5851 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135991.727306:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d15680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723340160:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135991.727420:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135991.731834:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d15680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723340160:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135991.731876:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135991.732578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135991.733038:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070400 00000100:00100000:2.0:1789135991.733051:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070400 00000100:00100000:2.0:1789135991.733136:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:2.0:1789135991.733148:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:5608:x1876044696070400:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789135991.734963:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:5608:x1876044696070400:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 1802us (2390us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789135991.734979:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:2.0:1789135991.743051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135991.743196:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070528 00000100:00100000:3.0:1789135991.743206:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070528 00010000:00010000:3.0:1789135991.743252:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 28 pid: 5851 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.743294:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:3.0:1789135991.743304:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:2363:x1876044696070528:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.743319:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.743326:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 28 pid: 5851 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743340:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 28 pid: 5851 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743366:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96ad7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630196 expref: 28 pid: 5851 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743381:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135991.743387:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743396:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743403:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.743454:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.743518:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:2363:x1876044696070528:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 215us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.743526:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 71 00010000:00010000:1.0:1789135991.743602:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.743610:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.743663:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789135991.743669:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135991.743695:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.743746:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744134:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744141:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744159:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744165:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135991.744169:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744176:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744186:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135991.744189:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135991.744193:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744200:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031200/0x38eb79866bf96af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744215:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744222:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744227:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744239:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135991.744242:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744248:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744255:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba06ca52a00) 00010000:00010000:1.0:1789135991.744257:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135991.744260:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744266:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030800/0x38eb79866bf96afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744304:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030200/0x38eb79866bf96aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63019d expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744316:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63019d expref: 26 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.744323:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135991.744325:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135991.744327:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba040031c00, rc 0) 00000100:00100000:1.0:1789135991.744365:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba074303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11676:x1876044696070144:12345-192.168.204.41@tcp:101:stat.0 Request processed in 17980us (18193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135991.744373:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 156 00000100:00100000:1.0:1789135991.837422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135991.837862:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070784 00000100:00100000:2.0:1789135991.837874:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070784 00000100:00100000:2.0:1789135991.837983:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 157 00000100:00100000:2.0:1789135991.837994:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11682:x1876044696070784:12345-192.168.204.41@tcp:36:truncate.0 00010000:00010000:2.0:1789135991.838057:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135991.838092:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040031c00/0x38eb79866bf96b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63019d expref: 26 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.838125:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135991.838130:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135991.838355:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.838370:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.838381:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135991.838435:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789135991.838462:0:5850:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000932b8e37 reply state 0000000021319dff transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.838472:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135991.839169:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11682:x1876044696070784:12345-192.168.204.41@tcp:36:truncate.0 Request processed in 1173us (1754us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789135991.839178:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 157 00000020:00080000:2.0:1789135991.839185:0:5850:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789135991.841873:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.841890:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.841898:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.841905:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135991.841928:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.841937:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.841956:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135991.842015:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135991.842022:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.842028:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96b08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.004519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.004641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696070912 00000100:00100000:3.0:1789135992.004652:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696070912 00000100:00100000:3.0:1789135992.004771:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 158 00000100:00100000:3.0:1789135992.004783:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:11696:x1876044696070912:12345-192.168.204.41@tcp:101:stat.0 00010000:00010000:3.0:1789135992.004807:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135992.004828:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301a4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004920:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004939:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004952:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004984:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004991:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.004999:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005360:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005370:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005377:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135992.005410:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789135992.005414:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135992.005433:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005444:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005452:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005458:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005465:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005470:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135992.005475:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005482:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005502:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135992.005504:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135992.005510:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005516:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005529:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005534:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005540:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005544:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135992.005546:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005551:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005558:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1e9600) 00010000:00010000:3.0:1789135992.005559:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135992.005563:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005567:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005609:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005621:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.005628:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135992.005630:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135992.005633:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789135992.005752:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11696:x1876044696070912:12345-192.168.204.41@tcp:101:stat.0 Request processed in 971us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.005760:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 158 00000100:00080000:0.0:1789135992.007024:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135992.092961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.093126:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696071168 00000100:00100000:1.0:1789135992.093136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696071168 00000100:00100000:1.0:1789135992.093212:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 159 00000100:00100000:1.0:1789135992.093222:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11706:x1876044696071168:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135992.093241:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135992.093267:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301ab expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.093552:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1789135992.093776:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ab expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.093792:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:1.0:1789135992.093795:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135992.093801:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ab expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.093814:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7200, rc 0) 00000100:00100000:1.0:1789135992.094575:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:11706:x1876044696071168:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1350us (1620us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789135992.094585:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 159 00000100:00100000:2.0:1789135992.108928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.109204:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696071424 00000100:00100000:3.0:1789135992.109213:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696071424 00000100:00100000:3.0:1789135992.109272:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:3.0:1789135992.109283:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:11706:x1876044696071424:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135992.109799:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:11706:x1876044696071424:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 517us (882us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789135992.109809:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:0.0:1789135992.200609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.203322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696071680 00000100:00100000:3.0:1789135992.203339:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696071680 00000100:00100000:3.0:1789135992.203656:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 160 00000100:00100000:3.0:1789135992.203668:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+30:11712:x1876044696071680:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135992.203695:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135992.203734:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96b39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.203863:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.203879:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.203888:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.203925:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.203939:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 31 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.203953:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723340288:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135992.204066:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135992.215115:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a5bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723340288:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135992.215179:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.218918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135992.219113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696071808 00000100:00100000:2.0:1789135992.219124:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696071808 00010000:00010000:2.0:1789135992.219185:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 32 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.219222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:2.0:1789135992.219231:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:2363:x1876044696071808:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135992.219245:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135992.219252:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 32 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219264:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 32 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219286:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301a4 expref: 32 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135992.219314:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219322:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219329:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.219363:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135992.219419:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:2363:x1876044696071808:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 189us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.219427:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 72 00010000:00010000:1.0:1789135992.220186:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.220198:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.220221:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789135992.220415:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96b39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.220433:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.220440:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135992.220443:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135992.220445:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:1.0:1789135992.220495:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11712:x1876044696071680:12345-192.168.204.41@tcp:101:bash.0 Request processed in 16830us (19897us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789135992.220503:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 160 00000100:00100000:0.0:1789135992.227621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135992.233529:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072064 00000100:00100000:2.0:1789135992.233553:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072064 00000100:00100000:1.0:1789135992.234968:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 161 00000100:00100000:1.0:1789135992.234997:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11712:x1876044696072064:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:1.0:1789135992.235662:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.235688:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.235727:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135992.235792:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789135992.235822:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bacabb7d reply state 00000000df11f1c3 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.235831:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135992.236349:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11712:x1876044696072064:12345-192.168.204.41@tcp:36:bash.0 Request processed in 1363us (9409us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789135992.236376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 161 00000020:00080000:1.0:1789135992.236383:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135992.243988:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244016:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244026:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244033:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135992.244040:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244049:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244074:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135992.244078:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135992.244085:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.244092:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.258919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.259072:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072192 00000100:00100000:1.0:1789135992.259087:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072192 00000100:00100000:1.0:1789135992.259191:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 162 00000100:00100000:1.0:1789135992.259204:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:11712:x1876044696072192:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:1.0:1789135992.259273:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135992.259301:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301b9 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.259435:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.259453:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.259464:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.259508:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.259525:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 34 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.259543:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723340416:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135992.259867:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042faf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135992.265865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.265967:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072320 00000100:00100000:3.0:1789135992.265983:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072320 00010000:00010000:3.0:1789135992.266052:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 35 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.266109:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00100000:3.0:1789135992.266153:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:2364:x1876044696072320:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135992.266188:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.266197:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 35 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.266213:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 35 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.266253:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135992.266261:0:6713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.266274:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.266285:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.266317:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135992.266403:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d17840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:2364:x1876044696072320:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 253us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.266413:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 73 00010000:00010000:1.0:1789135992.270496:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96b40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b2 expref: 34 pid: 5851 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.270532:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723340416:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135992.270646:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.270686:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.270693:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.270877:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789135992.270883:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135992.270912:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.270972:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b9 expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.270992:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b9 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.271001:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135992.271005:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135992.271009:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789135992.271117:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:11712:x1876044696072192:12345-192.168.204.41@tcp:101:bash.0 Request processed in 11914us (12213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.271127:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 162 00000100:00100000:0.0:1789135992.278637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.279086:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072576 00000100:00100000:1.0:1789135992.279111:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072576 00000100:00100000:1.0:1789135992.279204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:1.0:1789135992.279218:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+33:11712:x1876044696072576:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:1.0:1789135992.279595:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11712:x1876044696072576:12345-192.168.204.41@tcp:35:bash.0 Request processed in 379us (974us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789135992.279619:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789135992.391745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135992.391984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072832 00000100:00100000:2.0:1789135992.391998:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072832 00000100:00100000:2.0:1789135992.392089:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 163 00000100:00100000:2.0:1789135992.392110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11722:x1876044696072832:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135992.392145:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135992.392175:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135992.392564:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1789135992.392817:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96b63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301c0 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.392860:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789135992.392864:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135992.392871:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301c0 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.392887:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937e00, rc 0) 00000100:00100000:2.0:1789135992.392975:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11722:x1876044696072832:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 869us (1280us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789135992.392984:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 163 00000100:00100000:0.0:1789135992.402582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.402866:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696072960 00000100:00100000:3.0:1789135992.402881:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696072960 00000100:00100000:1.0:1789135992.403063:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 164 00000100:00100000:1.0:1789135992.403079:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11722:x1876044696072960:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:1.0:1789135992.403413:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.403434:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.403449:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.403470:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.403478:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.403484:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405044:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405066:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405079:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135992.405163:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405191:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405198:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405207:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.405213:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135992.405218:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.406874:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.406910:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135992.406913:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135992.406921:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.406930:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407058:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407067:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407074:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407097:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135992.407101:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407109:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407128:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba069d75100) 00010000:00010000:1.0:1789135992.407130:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135992.407134:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407142:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407161:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407167:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407174:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407179:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135992.407182:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407188:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407205:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135992.407207:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135992.407211:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.407216:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.407354:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11722:x1876044696072960:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 4272us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.407366:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 164 00000100:00100000:0.0:1789135992.412828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.413042:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696073216 00000100:00100000:1.0:1789135992.413055:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696073216 00000100:00100000:1.0:1789135992.413128:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:1.0:1789135992.413140:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11722:x1876044696073216:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135992.413747:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:11722:x1876044696073216:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 606us (934us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789135992.413757:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:0.0:1789135992.464352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135992.464491:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696073472 00000100:00100000:2.0:1789135992.464503:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696073472 00000100:00100000:2.0:1789135992.464730:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 165 00000100:00100000:2.0:1789135992.464743:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:11725:x1876044696073472:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135992.464774:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135992.464800:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96b86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301c7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464912:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464930:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464943:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464961:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464986:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.464993:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465408:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465418:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465426:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135992.465437:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789135992.465544:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465553:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465560:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465567:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135992.465572:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465581:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465674:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135992.465678:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.465684:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465691:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465737:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465745:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465752:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465757:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135992.465759:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465765:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465773:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2700) 00010000:00010000:2.0:1789135992.465776:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.465779:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465785:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465859:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96b86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301c7 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465875:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301c7 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.465883:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135992.465885:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135992.465888:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937400, rc 0) 00000100:00100000:2.0:1789135992.466024:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11725:x1876044696073472:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1284us (1687us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789135992.466034:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 165 00000100:00100000:0.0:1789135992.471173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135992.472053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.472114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696073728 00000100:00100000:3.0:1789135992.472429:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696073728 00000100:00100000:3.0:1789135992.472515:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:3.0:1789135992.472531:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11725:x1876044696073728:12345-192.168.204.41@tcp:54:lfs.0 00000100:00100000:2.0:1789135992.472882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696073600 00000100:00100000:2.0:1789135992.472889:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696073600 00000100:00100000:2.0:1789135992.472944:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789135992.472961:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:2365:x1876044696073600:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135992.472978:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.472982:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.473005:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96b9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301c7 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473024:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473040:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473074:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473082:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473090:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473097:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135992.473103:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473113:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.473177:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:2.0:1789135992.473185:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135992.473188:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135992.473193:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135992.473197:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.473205:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.473554:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:2365:x1876044696073600:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 600us (2395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.473563:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:3.0:1789135992.473611:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:11725:x1876044696073728:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 1084us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.473627:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 166 00000100:00100000:0.0:1789135992.477150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.477268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696073984 00000100:00100000:3.0:1789135992.477280:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696073984 00000100:00100000:3.0:1789135992.477356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:3.0:1789135992.477369:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:11725:x1876044696073984:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135992.478031:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11725:x1876044696073984:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 663us (894us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789135992.478041:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:0.0:1789135992.639989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.640196:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696074240 00000100:00100000:1.0:1789135992.640209:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696074240 00000100:00100000:1.0:1789135992.640292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 167 00000100:00100000:1.0:1789135992.640305:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11743:x1876044696074240:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:1.0:1789135992.640343:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135992.640372:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96bb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301ce expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.641907:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96bb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.641966:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.641982:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.641999:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789135992.642929:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96bb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ce expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.642958:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ce expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.642969:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:1.0:1789135992.642972:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789135992.642977:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6a00, rc 0) 00000100:00100000:1.0:1789135992.643161:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11743:x1876044696074240:12345-192.168.204.41@tcp:101:cat.0 Request processed in 2857us (3187us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789135992.643172:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 167 00010000:00010000:2.0:1789135992.653081:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135992.675864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.675985:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696074368 00000100:00100000:1.0:1789135992.675997:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696074368 00000100:00100000:1.0:1789135992.676075:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 168 00000100:00100000:1.0:1789135992.676087:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11744:x1876044696074368:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135992.676122:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135992.676151:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301d5 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.676284:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.676303:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.676319:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.676573:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789135992.676579:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135992.676661:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.676695:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf96bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301d5 expref: 42 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.677087:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301d5 expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.677098:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135992.677102:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135992.677106:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7200, rc 0) 00000100:00100000:1.0:1789135992.677192:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11744:x1876044696074368:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1107us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.677202:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 168 00000100:00100000:0.0:1789135992.682812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135992.683269:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696074752 00000100:00100000:1.0:1789135992.683283:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696074752 00000100:00100000:1.0:1789135992.683621:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:1.0:1789135992.683635:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11744:x1876044696074752:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135992.684200:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11744:x1876044696074752:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 567us (1404us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789135992.684210:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:0.0:1789135992.688629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.688787:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696074880 00000100:00100000:3.0:1789135992.688800:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696074880 00000100:00100000:3.0:1789135992.689001:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:3.0:1789135992.689014:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11744:x1876044696074880:12345-192.168.204.41@tcp:103:lfs.0 00010000:00010000:3.0:1789135992.689038:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789135992.689073:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301b9 expref: 42 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.689104:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ce expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.689119:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63017a expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.689133:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135992.689145:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135992.689237:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11744:x1876044696074880:12345-192.168.204.41@tcp:103:lfs.0 Request processed in 225us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.689266:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789135992.692245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.692397:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075008 00000100:00100000:3.0:1789135992.692409:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075008 00000100:00100000:3.0:1789135992.692492:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 169 00000100:00100000:3.0:1789135992.692505:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11744:x1876044696075008:12345-192.168.204.41@tcp:58:lfs.0 00010000:00010000:3.0:1789135992.692695:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.692751:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.692768:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135992.693502:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789135992.693795:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11744:x1876044696075008:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 1289us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.693806:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 169 00000100:00100000:0.0:1789135992.739596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135992.739967:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075136 00000100:00100000:3.0:1789135992.740235:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075136 00000100:00100000:3.0:1789135992.740322:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 170 00000100:00100000:3.0:1789135992.740335:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11746:x1876044696075136:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135992.740365:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135992.740395:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96bda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740511:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740570:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740585:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740605:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740613:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.740620:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743280:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743306:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743321:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135992.743378:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789135992.743384:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135992.743409:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743423:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743447:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743454:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743473:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743480:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135992.743486:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743495:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743513:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135992.743517:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135992.743524:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743531:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96be1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743546:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743614:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743621:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743633:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135992.743637:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743645:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743657:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1e9700) 00010000:00010000:3.0:1789135992.743660:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135992.743663:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743670:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96be8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743766:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743785:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.743793:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:3.0:1789135992.743796:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135992.743799:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:3.0:1789135992.743915:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11746:x1876044696075136:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 3581us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.743928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 170 00000040:00080000:2.0:1789135993.485681:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135993.485690:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135993.485761:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789135993.485768:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135993.485905:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723340544:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135993.486610:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044a7dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135993.491199:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073f75680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723340544:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135993.494568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.494682:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075264 00000100:00100000:0.0:1789135993.494692:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075264 00000100:00100000:0.0:1789135993.494874:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:0.0:1789135993.494885:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11757:x1876044696075264:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135993.494920:0:5852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135993.495047:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11757:x1876044696075264:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 162us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135993.495055:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 171 00000100:00100000:0.0:1789135993.503656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.503790:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075392 00000100:00100000:1.0:1789135993.503800:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075392 00000100:00100000:1.0:1789135993.503910:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 172 00000100:00100000:1.0:1789135993.503920:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11757:x1876044696075392:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.504082:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504101:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504115:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504131:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504139:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504146:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504335:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504353:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504361:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135993.504396:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789135993.504401:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135993.504481:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504494:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504500:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504506:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504512:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.504516:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504523:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504612:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:1.0:1789135993.504615:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135993.504621:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504637:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96bf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504649:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504655:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504660:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504665:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.504669:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504675:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504682:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8ba069d75100) 00010000:00010000:1.0:1789135993.504685:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135993.504688:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504693:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96bfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504780:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504786:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504798:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504803:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.504807:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504824:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504832:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:1.0:1789135993.504836:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135993.504838:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.504844:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.505088:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11757:x1876044696075392:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 Request processed in 1167us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.505098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 172 00000100:00100000:0.0:1789135993.509833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.510120:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075648 00000100:00100000:1.0:1789135993.510130:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075648 00000100:00100000:1.0:1789135993.510220:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 173 00000100:00100000:1.0:1789135993.510230:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11757:x1876044696075648:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.510250:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135993.510272:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301e3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510400:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510426:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510440:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135993.510452:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789135993.510570:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510578:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510585:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510592:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.510595:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510602:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510614:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:1.0:1789135993.510617:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135993.510623:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510639:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510679:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301e3 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510690:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:1.0:1789135993.510692:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135993.510696:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301e3 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.510743:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6e00, rc 0) 00000100:00100000:1.0:1789135993.510818:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696075648:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 580us (997us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789135993.510826:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 173 00000100:00100000:1.0:1789135993.517435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135993.519790:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696075776 00000100:00100000:2.0:1789135993.519806:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696075776 00000100:00100000:2.0:1789135993.521094:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 174 00000100:00100000:2.0:1789135993.521113:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696075776:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789135993.521148:0:8031:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789135993.521272:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696075776:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 166us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135993.521280:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 174 00000100:00100000:0.0:1789135993.534302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.534348:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076032 00000100:00100000:0.0:1789135993.534357:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076032 00000100:00100000:0.0:1789135993.534429:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:0.0:1789135993.534440:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696076032:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135993.534462:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135993.534465:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789135993.534491:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7200/0x38eb79866bf96bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301d5 expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.534510:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789135993.534515:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135993.534528:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135993.535792:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789135993.537590:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.537623:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.537636:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.537726:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ea expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.537747:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ea expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.537765:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba06ca52500) 00010000:00010000:0.0:1789135993.537768:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135993.537772:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc800, rc 0) 00000100:00100000:0.0:1789135993.537862:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11757:x1876044696076032:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 3423us (3578us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789135993.537872:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 175 00000100:00100000:0.0:1789135993.543493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.547658:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076288 00000100:00100000:1.0:1789135993.547674:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076288 00000100:00100000:1.0:1789135993.547764:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00100000:1.0:1789135993.547776:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11757:x1876044696076288:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.547848:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135993.547878:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ea expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.547897:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba06ca52500) 00010000:00010000:1.0:1789135993.547908:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135993.547956:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.547971:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.547982:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.547998:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.548005:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.548022:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549583:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549599:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549659:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549665:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.549670:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549678:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549803:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135993.549816:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135993.549822:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549830:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96c35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549845:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549850:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549855:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549860:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.549862:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549867:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549874:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd5589847 (ffff8ba069d75100) 00010000:00010000:1.0:1789135993.549877:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135993.549879:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.549883:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd5589847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.550341:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696076288:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 2561us (7180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135993.550351:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 176 00000100:00100000:3.0:1789135993.563345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.563393:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076416 00000100:00100000:3.0:1789135993.563403:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076416 00000100:00100000:3.0:1789135993.563460:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 177 00000100:00100000:3.0:1789135993.563541:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+41:11757:x1876044696076416:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135993.563562:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135993.563586:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301f1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.563624:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.563639:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.563652:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.566402:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.566432:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.566441:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135993.566444:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135993.566448:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:3.0:1789135993.566672:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11757:x1876044696076416:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 3133us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.566681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 177 00000100:00100000:3.0:1789135993.576094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135993.580065:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076672 00000100:00100000:2.0:1789135993.580078:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076672 00000100:00100000:2.0:1789135993.580148:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 178 00000100:00100000:2.0:1789135993.580165:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11757:x1876044696076672:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135993.580246:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.580263:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.580276:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135993.580629:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789135993.580642:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 467454940826ns, next at 468454937774ns, rc = 0 00000004:00010000:2.0:1789135993.580763:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008df36998 reply state 000000008e7ca080 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135993.580774:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135993.580889:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+44:11757:x1876044696076672:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 725us (4809us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789135993.580897:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 178 00000100:00100000:1.0:1789135993.588511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.588553:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076800 00000100:00100000:1.0:1789135993.588563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076800 00000100:00100000:1.0:1789135993.588621:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 179 00000100:00100000:1.0:1789135993.588631:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+44:11757:x1876044696076800:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.588656:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135993.588678:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301f8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.588762:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.588777:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.588797:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:1.0:1789135993.588800:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135993.588805:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6c00, rc 0) 00000100:00100000:1.0:1789135993.588877:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:11757:x1876044696076800:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 246us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.588885:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 179 00010000:00010000:2.0:1789135993.589825:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589838:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589846:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589851:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135993.589856:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589865:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589879:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:2.0:1789135993.589882:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789135993.589887:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.589902:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.595794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.596106:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696076928 00000100:00100000:0.0:1789135993.596116:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696076928 00000100:00100000:0.0:1789135993.596314:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:0.0:1789135993.596326:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696076928:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789135993.596343:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135993.602352:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696076928:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 6015us (6552us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789135993.602366:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:1.0:1789135993.615228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.615332:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696077184 00000100:00100000:3.0:1789135993.615342:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696077184 00000100:00100000:3.0:1789135993.615424:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:3.0:1789135993.615435:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+44:11757:x1876044696077184:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135993.615880:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:11757:x1876044696077184:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 444us (658us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789135993.615889:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:2.0:1789135993.619213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.619296:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696077440 00000100:00100000:3.0:1789135993.619306:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696077440 00000100:00100000:3.0:1789135993.619399:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 180 00000100:00100000:3.0:1789135993.619410:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:11757:x1876044696077440:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789135993.619543:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:11757:x1876044696077440:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.619551:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 180 00000100:00100000:2.0:1789135993.625083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.625318:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696077568 00000100:00100000:1.0:1789135993.625334:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696077568 00000100:00100000:1.0:1789135993.625392:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 181 00000100:00100000:1.0:1789135993.625402:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+45:11757:x1876044696077568:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.625422:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135993.625443:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96c5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6301ff expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.625912:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.626004:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.626020:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135993.626065:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135993.626085:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.626114:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96c5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ff expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.626129:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ff expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.626137:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:1.0:1789135993.626140:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135993.626144:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7a00, rc 0) 00000100:00100000:1.0:1789135993.626250:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073986940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:11757:x1876044696077568:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 849us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.626264:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 181 00000100:00100000:3.0:1789135993.630518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.630602:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696077696 00000100:00100000:1.0:1789135993.630611:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696077696 00000100:00100000:1.0:1789135993.630679:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:1.0:1789135993.630689:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696077696:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.630724:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135993.630747:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630206 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135993.630773:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c78, blocks: 0x1 00010000:00010000:1.0:1789135993.630791:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1789135993.630795:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135993.630814:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.630835:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.630848:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7400, rc 0) 00000100:00100000:1.0:1789135993.630911:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696077696:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 223us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.630918:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:3.0:1789135993.635738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.635843:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696077952 00000100:00100000:1.0:1789135993.635852:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696077952 00000100:00100000:1.0:1789135993.636013:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 182 00000100:00100000:1.0:1789135993.636036:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:11757:x1876044696077952:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789135993.636172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:11757:x1876044696077952:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 148us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.636181:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 182 00000100:00100000:2.0:1789135993.640050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.640141:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078080 00000100:00100000:0.0:1789135993.640150:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078080 00000100:00100000:0.0:1789135993.640209:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:0.0:1789135993.640220:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:11757:x1876044696078080:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135993.640239:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135993.640258:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63020d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.640291:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.640311:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135993.640316:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135993.640322:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.640355:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.640368:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.640382:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876044723340672:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135993.640502:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135993.644581:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1876044723340672:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135993.644648:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.644668:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc800, rc 0) 00000100:00100000:1.0:1789135993.644734:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:11757:x1876044696078080:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 4516us (4692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.644743:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:0.0:1789135993.644912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.644938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078208 00000100:00100000:0.0:1789135993.644945:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078208 00010000:00010000:0.0:1789135993.644976:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.645006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:0.0:1789135993.645015:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696078208:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135993.645029:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135993.645051:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.645077:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.645099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f182920e/0x38eb79866bf96c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630206 expref: 9 pid: 6697 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.645111:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135993.645116:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135993.645125:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.645136:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.645169:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.645182:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1876044723340800:192.168.204.41@tcp:105: 00000100:00100000:0.0:1789135993.645233:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135993.647732:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1876044723340800:192.168.204.41@tcp:105: 00010000:00010000:0.0:1789135993.647763:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135993.647835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696078208:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2819us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135993.647846:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:1.0:1789135993.662882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.662923:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078336 00000100:00100000:1.0:1789135993.662932:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078336 00002000:00100000:1.0:1789135993.662990:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ba085f21680 x1876044696078336/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:424/0 lens 504/0 e 0 to 0 dl 1789136004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135993.663002:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f21680 with x1876044696078336 ext(0->8) 00002000:00010000:1.0:1789135993.663009:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f21680 00000100:00100000:1.0:1789135993.663045:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:1.0:1789135993.663055:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2366:x1876044696078336:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789135993.668252:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2366:x1876044696078336:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 Request processed in 5185us (5371us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789135993.668266:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00002000:00100000:1.0:1789135993.668279:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ba085f21680 x1876044696078336/t4294967314(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:424/0 lens 504/448 e 0 to 0 dl 1789136004 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135993.668298:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f21680 with x1876044696078336 ext(0->8) 00002000:00010000:1.0:1789135993.668305:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f21680 00000040:00080000:0.0:1789135993.669379:0:12932:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135993.669386:0:12932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135993.669424:0:12932:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789135993.669429:0:12932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135993.677463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.677861:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078464 00000100:00100000:3.0:1789135993.677873:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078464 00000100:00100000:3.0:1789135993.677933:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 183 00000100:00100000:3.0:1789135993.677944:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:11757:x1876044696078464:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1789135993.678278:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135993.712393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.712431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.712511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.712542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078592 00000100:00100000:1.0:1789135993.712552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078592 00000100:00100000:1.0:1789135993.712610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 334 00000100:00100000:1.0:1789135993.712635:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696078592:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135993.712728:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696078592:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.712735:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 334 00000100:00100000:1.0:1789135993.712770:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078848 00000100:00100000:1.0:1789135993.712774:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078848 00000100:00100000:1.0:1789135993.712825:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 185 00000100:00100000:1.0:1789135993.712833:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696078848:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135993.712863:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2363:x1876044696078848:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.712869:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 185 00000100:00080000:1.0:1789135993.712974:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135993.716905:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078720 00000100:00100000:3.0:1789135993.716922:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078720 00000100:00100000:3.0:1789135993.716999:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:3.0:1789135993.717023:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696078720:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135993.717110:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f22d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696078720:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 90us (4729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.717118:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00080000:2.0:1789135993.717873:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135993.752292:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+46:11757:x1876044696078464:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 Request processed in 74329us (74816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.752306:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 183 00000001:00080000:3.0:1789135993.752349:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:3.0:1789135993.752378:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1789135993.752417:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789135993.752422:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789135993.752446:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1789135993.752468:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789135993.752478:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789135993.753037:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723340928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789135993.753095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135993.755365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135993.755616:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723340928 00000100:00100000:2.0:1789135993.755696:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723340928 00000100:00100000:2.0:1789135993.755772:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696078976 00000100:00100000:2.0:1789135993.755776:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696078976 00000100:00100000:2.0:1789135993.755801:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789135993.755821:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723340928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789135993.756036:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789135993.756041:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135992 00002000:00010000:2.0:1789135993.756043:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789135993.756046:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135992 -> 1789135992 00002000:00010000:2.0:1789135993.756048:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789135993.756107:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:2.0:1789135993.756109:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723340928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (3014us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789135993.756116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135993.756117:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2366:x1876044696078976:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1789135993.757052:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789135993.757724:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b9f46254000/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789135993.757736:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723340928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789135993.808647:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2366:x1876044696078976:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 Request processed in 52519us (53278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135993.808662:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 57 00000001:00080000:3.0:1789135993.808874:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789135993.808887:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1789135993.808897:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789135993.819419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.819745:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696079232 00000100:00100000:3.0:1789135993.819755:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696079232 00000100:00100000:3.0:1789135993.819825:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 184 00000100:00100000:3.0:1789135993.819835:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11757:x1876044696079232:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135993.819891:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135993.819919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301ff expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.819960:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135993.819966:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135993.819997:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.820011:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.820022:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135993.820292:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000038176f49 reply state 000000006b0ed928 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.820301:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135993.820402:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11757:x1876044696079232:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 568us (993us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789135993.820409:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 184 00000100:00100000:2.0:1789135993.830624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135993.830671:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696079360 00000100:00100000:2.0:1789135993.830680:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696079360 00000100:00100000:2.0:1789135993.830757:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 58 00000100:00100000:2.0:1789135993.830767:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696079360:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789135993.831043:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789135993.831046:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789135992 -> 1789135991 00002000:00010000:2.0:1789135993.831049:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789135989 00002000:00010000:2.0:1789135993.831051:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135992 -> 1789135991 00002000:00010000:2.0:1789135993.831053:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789135993.831108:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696079360:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 343us (497us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789135993.831116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 58 00010000:00010000:3.0:1789135993.831624:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831636:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831643:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831648:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135993.831653:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831670:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831686:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135993.831688:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135993.831693:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.831736:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96c7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.840309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.840457:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696079616 00000100:00100000:0.0:1789135993.840466:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696079616 00000100:00100000:0.0:1789135993.840525:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 185 00000100:00100000:0.0:1789135993.840536:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11757:x1876044696079616:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135993.840609:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.840627:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.840638:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.840671:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.840687:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 18 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.840897:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723341056:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135993.841440:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135993.846102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.846135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696079744 00000100:00100000:3.0:1789135993.846143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696079744 00010000:00010000:3.0:1789135993.846189:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.846226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:3.0:1789135993.846236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:2364:x1876044696079744:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135993.846251:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135993.846258:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.846270:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.846307:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:3.0:1789135993.846323:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.846334:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.846342:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.846362:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135993.846414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:2364:x1876044696079744:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 179us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.846422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 75 00010000:00010000:1.0:1789135993.846945:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f1 expref: 18 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.846962:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723341056:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135993.846985:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847002:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847008:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847038:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847045:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847051:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847057:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cd800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135993.847061:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847069:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847080:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:1.0:1789135993.847083:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789135993.847086:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.847092:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96c82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.847148:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:11757:x1876044696079616:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 Request processed in 6615us (6853us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789135993.847163:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 185 00000100:00100000:3.0:1789135993.859649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.859950:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696079872 00000100:00100000:0.0:1789135993.859960:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696079872 00000100:00100000:0.0:1789135993.860020:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:0.0:1789135993.860031:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2366:x1876044696079872:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789135993.860084:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.860107:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.860115:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135993.860120:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135993.860125:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.860159:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.860173:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 8 pid: 6700 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.860189:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723341184:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135993.860442:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117000 going to sleep for 11 seconds 00000100:00100000:2.0:1789135993.867486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135993.872044:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1876044723341184:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135993.872081:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.872498:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696080000 00000100:00100000:1.0:1789135993.872689:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696080000 00010000:00010000:1.0:1789135993.873067:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.873110:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 76 00000100:00100000:1.0:1789135993.873121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696080000:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135993.873137:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135993.873161:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.873175:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.873199:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee1b530/0x38eb79866bf96c74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63020d expref: 9 pid: 6700 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.873214:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135993.873218:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135993.873224:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.873234:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.874061:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135993.874133:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696080000:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 1011us (6653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135993.874142:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 76 00010000:00010000:2.0:1789135993.876038:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876060:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876102:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876111:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876120:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876143:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cd800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135993.876148:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876156:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876177:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.876184:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48693bd/0x38eb79866bf96c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135993.876426:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696079872:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 Request processed in 16393us (16784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135993.876436:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:2.0:1789135993.890384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135993.890451:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696080256 00000100:00100000:1.0:1789135993.890461:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696080256 00000100:00100000:1.0:1789135993.890538:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 186 00000100:00100000:1.0:1789135993.890549:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+17:11757:x1876044696080256:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.890631:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.890649:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.890662:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.890950:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.890963:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.890972:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.891008:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.891037:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 18 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.891053:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723341312:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135993.891131:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042fafe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135993.894592:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723341312:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135993.894625:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.897955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135993.898315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696080384 00000100:00100000:2.0:1789135993.898324:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696080384 00010000:00010000:2.0:1789135993.898364:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135993.898396:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:2.0:1789135993.898405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:2363:x1876044696080384:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135993.898419:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135993.898443:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898456:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898482:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301f8 expref: 19 pid: 5850 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898497:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:2.0:1789135993.898502:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898512:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898636:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.898678:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135993.898750:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696080384:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 346us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135993.898759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 77 00010000:00010000:0.0:1789135993.899039:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135993.899048:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135993.899231:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789135993.899387:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789135993.899441:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789135993.899965:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723341440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789135993.900022:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135993.900046:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135993.900744:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723341440 00000100:00100000:3.0:1789135993.900752:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723341440 00000100:00100000:3.0:1789135993.900814:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135993.900824:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723341440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789135993.900926:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723341440:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.900933:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135993.901208:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789135993.901214:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b9f46254000, transno 4294967315 00000100:00100000:2.0:1789135993.901235:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723341440:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789135993.901756:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789135993.901852:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723341568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789135993.901892:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135993.901916:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135993.902614:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723341568 00000100:00100000:3.0:1789135993.902621:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723341568 00000100:00100000:3.0:1789135993.902648:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135993.902656:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1876044723341568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789135993.902864:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1876044723341568:12345-0@lo:1000:mdt00_002.0 Request processed in 208us (970us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789135993.902871:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135993.903171:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1876044723341568:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789135993.903205:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903215:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903223:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903229:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135993.903233:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903242:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903256:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c1e9800) 00010000:00010000:2.0:1789135993.903259:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135993.903264:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903270:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96c97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903308:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903314:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903320:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903332:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135993.903335:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903342:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903349:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:2.0:1789135993.903352:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135993.903355:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903360:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96bd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903381:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903395:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903405:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903431:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.903444:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 21 pid: 5851 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135993.903467:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46257480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723341696:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135993.903721:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1186c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135993.915094:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46257480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723341696:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135993.915128:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135993.917969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.918544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696080512 00000100:00100000:3.0:1789135993.918555:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696080512 00010000:00010000:3.0:1789135993.918600:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 22 pid: 5851 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.918650:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:3.0:1789135993.918660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:2364:x1876044696080512:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135993.918677:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135993.918684:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 22 pid: 5851 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918727:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 22 pid: 5851 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6301dc expref: 22 pid: 5851 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918771:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:3.0:1789135993.918777:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918787:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918794:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.918845:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135993.918901:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:2364:x1876044696080512:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 242us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135993.918910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 78 00010000:00010000:3.0:1789135993.919026:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919034:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919046:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919052:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919059:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919066:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135993.919070:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919078:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919087:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:3.0:1789135993.919090:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135993.919093:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919110:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96c9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919133:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919140:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919145:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919149:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135993.919152:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919157:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919165:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1e9600) 00010000:00010000:3.0:1789135993.919167:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135993.919170:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.919176:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96c90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135993.922053:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11757:x1876044696080256:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 31491us (31664us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789135993.922069:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 186 00000020:00080000:3.0:1789135993.922089:0:5852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789135993.922243:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135993.922248:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135993.933833:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789135993.933855:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135993.936754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135993.936796:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696080768 00000100:00100000:3.0:1789135993.936814:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696080768 00000100:00100000:3.0:1789135993.936868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789135993.936878:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11757:x1876044696080768:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789135993.937581:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789135993.937689:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789135993.937769:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937788:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937812:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937822:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937829:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937835:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.937856:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135993.937956:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:11757:x1876044696080768:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 1078us (1212us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789135993.937964:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 50 00000020:00080000:3.0:1789135993.937969:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135993.938024:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135993.938031:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.938037:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789135993.938041:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.938050:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.938063:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ba05c659c00) 00010000:00010000:3.0:1789135993.938066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135993.938071:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.938078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ca5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.938097:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135993.938099:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135993.938100:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135994.062374:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135994.062400:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723341824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135994.062478:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.062573:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723341824 00000100:00100000:0.0:1789135994.062584:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723341824 00000100:00100000:0.0:1789135994.062656:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789135994.062666:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723341824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135994.062724:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135994.062773:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723341824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.062810:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789135994.062834:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135994.062873:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723341824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135994.064492:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723342080:0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.064561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.064691:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723341952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.064746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.064808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723341952 00000100:00100000:0.0:1789135994.064814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723341952 00000100:00100000:0.0:1789135994.064859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789135994.064869:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723341952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.064915:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723341952:12345-0@lo:400:kworker.0 Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.064922:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789135994.064968:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f23840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723341952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.065017:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723342208:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.065043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.065087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723342080 00000100:00100000:0.0:1789135994.065091:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723342080 00000100:00100000:0.0:1789135994.065115:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723342208 00000100:00100000:0.0:1789135994.065117:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723342208 00000100:00100000:0.0:1789135994.065144:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789135994.065151:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723342080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.065225:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789135994.065234:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723342208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.065274:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723342208:12345-0@lo:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.065298:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789135994.065331:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723342208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135994.073585:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723342336:0@lo:400:kworker.0 00000100:00100000:1.0:1789135994.073664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.075331:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723342336 00000100:00100000:3.0:1789135994.075345:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723342336 00000100:00100000:3.0:1789135994.075427:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789135994.075438:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723342336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.075535:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f23840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723342336:12345-0@lo:400:kworker.0 Request processed in 99us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.075543:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789135994.075596:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723342336:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.081392:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723342080:12345-0@lo:400:kworker.0 Request processed in 16229us (16819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.081407:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1789135994.081459:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135994.086345:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723342080:0@lo:400:kworker.0 00000100:00100000:1.0:1789135994.574414:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07c1b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723342464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135994.574511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135994.574970:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723342464 00000100:00100000:2.0:1789135994.574979:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723342464 00000100:00100000:2.0:1789135994.575037:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789135994.575045:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044723342464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135994.575070:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789135994.575389:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07c1b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723342464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135994.575436:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044723342464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.575446:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1789135994.701162:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135995.685051:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:0.0:1789135995.740489:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135995.750080:0:12985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135995.750095:0:12985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135995.750154:0:12985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789135995.750162:0:12985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135995.850522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135995.851602:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696081024 00000100:00100000:0.0:1789135995.851620:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696081024 00000100:00100000:0.0:1789135995.851773:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 187 00000100:00100000:0.0:1789135995.851794:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:11776:x1876044696081024:12345-192.168.204.41@tcp:101:lfs.0 00000100:00080000:1.0:1789135995.851823:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135995.852151:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135995.852184:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630214 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135995.853144:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96cb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135995.853170:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135995.853185:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135995.853203:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1789135995.853545:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630214 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135995.853565:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630214 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135995.853575:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789135995.853578:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135995.853585:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cd800, rc 0) 00000100:00100000:0.0:1789135995.854031:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11776:x1876044696081024:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 2245us (3522us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789135995.854050:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 187 00000100:00100000:0.0:1789135995.861926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135995.862054:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696081152 00000100:00100000:1.0:1789135995.862071:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696081152 00000100:00100000:1.0:1789135995.862149:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 188 00000100:00100000:1.0:1789135995.862161:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11776:x1876044696081152:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:1.0:1789135995.862281:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862308:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862323:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862342:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862350:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862357:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862859:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862871:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862881:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135995.862952:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862969:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862989:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.862998:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863005:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135995.863011:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863020:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863037:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135995.863041:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135995.863048:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863055:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf96cc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863072:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863079:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863085:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863091:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135995.863102:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863109:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863118:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba069d75600) 00010000:00010000:1.0:1789135995.863121:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135995.863125:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863131:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf96cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863147:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863153:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863160:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863165:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135995.863169:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863174:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863182:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba069d75800) 00010000:00010000:1.0:1789135995.863184:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135995.863193:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135995.863200:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6800/0x38eb79866bf96ccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135995.863313:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11776:x1876044696081152:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 1151us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135995.863323:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 188 00000100:00100000:0.0:1789135995.937672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135995.938382:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696081408 00000100:00100000:2.0:1789135995.938398:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696081408 00000100:00100000:2.0:1789135995.938483:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 189 00000100:00100000:2.0:1789135995.938497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:11779:x1876044696081408:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135995.938526:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135995.938554:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96cd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63021b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938662:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938694:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938735:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938758:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938776:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.938784:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939229:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939239:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939246:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135995.939256:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789135995.939381:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939390:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939398:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939413:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135995.939419:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939427:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939442:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135995.939446:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135995.939451:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939457:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939470:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939475:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939481:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939486:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135995.939489:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939495:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939513:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2e00) 00010000:00010000:2.0:1789135995.939515:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135995.939518:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939524:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939578:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96cd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939595:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135995.939603:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:2.0:1789135995.939606:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135995.939608:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936c00, rc 0) 00000100:00100000:2.0:1789135995.940833:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11779:x1876044696081408:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 2328us (3165us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789135995.940847:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 189 00000100:00100000:3.0:1789135995.947783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135995.947831:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696081536 00000100:00100000:3.0:1789135995.947839:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696081536 00000100:00100000:3.0:1789135995.947910:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 190 00000100:00100000:3.0:1789135995.947921:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11779:x1876044696081536:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135995.947994:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948012:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948024:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948051:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948079:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948086:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.948093:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135995.950012:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.950037:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.950055:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135995.950058:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135995.950064:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135995.950071:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135995.950299:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07c1b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11779:x1876044696081536:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 2377us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135995.950311:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 190 00000100:00100000:2.0:1789135995.957092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135995.957234:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696081792 00000100:00100000:1.0:1789135995.957249:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696081792 00000100:00100000:1.0:1789135995.957328:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:1.0:1789135995.957340:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11779:x1876044696081792:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:1.0:1789135995.957641:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:11779:x1876044696081792:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 302us (569us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789135995.957651:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:2.0:1789135996.008386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.008566:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082048 00000100:00100000:3.0:1789135996.008577:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082048 00000100:00100000:3.0:1789135996.008649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 191 00000100:00100000:3.0:1789135996.008661:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:11304:x1876044696082048:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135996.008692:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135996.008773:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630222 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.008894:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.008910:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.008919:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.008958:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.008972:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 28 pid: 5852 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.008986:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723342592:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135996.009089:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135996.011869:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1876044723342592:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135996.011909:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.012357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.012648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082176 00000100:00100000:3.0:1789135996.012656:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082176 00010000:00010000:3.0:1789135996.012696:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 29 pid: 5852 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.012783:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:3.0:1789135996.012794:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:2364:x1876044696082176:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135996.012810:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135996.012817:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 29 pid: 5852 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012828:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 29 pid: 5852 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012849:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63021b expref: 29 pid: 5852 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012863:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135996.012869:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012878:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012897:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.012927:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135996.012991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:2364:x1876044696082176:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 199us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.012998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 79 00010000:00010000:2.0:1789135996.013125:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.013134:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135996.013163:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789135996.013335:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.013351:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.013358:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:2.0:1789135996.013361:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135996.013363:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:2.0:1789135996.013409:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11304:x1876044696082048:12345-192.168.204.41@tcp:101:bash.0 Request processed in 4751us (5036us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789135996.013417:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 191 00000100:00100000:2.0:1789135996.017289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.017545:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082432 00000100:00100000:3.0:1789135996.017571:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082432 00000100:00100000:3.0:1789135996.017634:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 192 00000100:00100000:3.0:1789135996.017644:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11304:x1876044696082432:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:3.0:1789135996.020225:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.020256:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.020270:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135996.020326:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789135996.020353:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000859e6612 reply state 0000000078a3ab86 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.020364:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789135996.020414:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789135996.020553:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11304:x1876044696082432:12345-192.168.204.41@tcp:36:bash.0 Request processed in 2905us (3269us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789135996.020563:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 192 00000020:00080000:3.0:1789135996.020570:0:8031:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789135996.022246:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022262:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022270:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022276:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.022281:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022290:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022320:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:2.0:1789135996.022324:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135996.022329:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.022336:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.022920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135996.023308:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082560 00000100:00100000:0.0:1789135996.023319:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082560 00000100:00100000:0.0:1789135996.023387:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 193 00000100:00100000:0.0:1789135996.023398:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11304:x1876044696082560:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:0.0:1789135996.023425:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135996.023445:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96d1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630229 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.023619:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96d1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630229 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.023634:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96d1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630229 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.023653:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:0.0:1789135996.023656:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135996.023659:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba086377200, rc 0) 00000100:00100000:0.0:1789135996.023750:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11304:x1876044696082560:12345-192.168.204.41@tcp:101:bash.0 Request processed in 354us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.023758:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 193 00000100:00100000:0.0:1789135996.028816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.028901:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082688 00000100:00100000:2.0:1789135996.028912:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082688 00000100:00100000:2.0:1789135996.028991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:2.0:1789135996.029002:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:11304:x1876044696082688:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135996.029021:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.029041:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630230 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135996.029067:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40c77, atime: 0x6aa40c75, ctime: 0x6aa40c77, blocks: 0xb 00010000:00010000:2.0:1789135996.029091:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1789135996.029107:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135996.029116:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.029141:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.029156:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937e00, rc 0) 00000100:00100000:2.0:1789135996.029237:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:11304:x1876044696082688:12345-192.168.204.41@tcp:101:bash.0 Request processed in 238us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135996.029245:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00080000:1.0:1789135996.029320:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135996.036511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135996.036690:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082816 00000100:00100000:0.0:1789135996.036743:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082816 00002000:00010000:0.0:1789135996.036807:0:6705:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789135996.036812:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8b9f46255a40 with x1876044696082816 ext(0->18446744073709551615) 00002000:00010000:0.0:1789135996.036825:0:6705:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b9f46255a40. 00000100:00100000:0.0:1789135996.036857:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:0.0:1789135996.036866:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2365:x1876044696082816:12345-192.168.204.41@tcp:10:bash.0 00002000:00010000:2.0:1789135996.037606:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789135996.037611:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789135991 -> 1789135995 00002000:00010000:2.0:1789135996.037614:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789135989 -> 1789135989 00002000:00010000:2.0:1789135996.037617:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135991 -> 1789135995 00002000:00010000:2.0:1789135996.037619:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789135996.037740:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2365:x1876044696082816:12345-192.168.204.41@tcp:10:bash.0 Request processed in 872us (1238us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789135996.037749:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00002000:00010000:2.0:1789135996.037753:0:6705:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789135996.037756:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8b9f46255a40 with x1876044696082816 ext(0->18446744073709551615) 00002000:00010000:2.0:1789135996.037773:0:6705:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b9f46255a40. 00000100:00100000:0.0:1789135996.125256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.125356:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696082944 00000100:00100000:3.0:1789135996.125368:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696082944 00000100:00100000:3.0:1789135996.125427:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00100000:3.0:1789135996.125437:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11793:x1876044696082944:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:3.0:1789135996.125508:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125525:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125553:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125570:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125578:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125586:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125943:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125952:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.125960:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135996.126003:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126014:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126022:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126031:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126047:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.126052:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126062:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126076:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135996.126079:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.126085:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126092:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126104:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126110:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126117:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126122:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.126125:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126131:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126148:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c659b00) 00010000:00010000:3.0:1789135996.126151:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.126154:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126160:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126174:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126181:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126187:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126193:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.126196:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126202:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126209:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135996.126212:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.126215:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.126221:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.126316:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11793:x1876044696082944:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 879us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.126325:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00100000:0.0:1789135996.191562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.191693:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696083200 00000100:00100000:2.0:1789135996.191735:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696083200 00000100:00100000:2.0:1789135996.191799:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 195 00000100:00100000:2.0:1789135996.191810:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+32:11796:x1876044696083200:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135996.191832:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.191855:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96d3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630237 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192325:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192343:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192373:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192390:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192398:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.192405:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196088:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196261:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196275:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135996.196290:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789135996.196409:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196418:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196425:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196430:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.196436:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196444:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196457:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135996.196490:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.196498:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196506:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196524:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196531:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196536:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196541:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.196544:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196550:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196558:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2a00) 00010000:00010000:3.0:1789135996.196561:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.196565:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196571:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196635:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630237 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196664:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630237 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.196672:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135996.196675:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789135996.196677:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5200, rc 0) 00000100:00100000:3.0:1789135996.197062:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11796:x1876044696083200:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 5250us (5510us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789135996.197072:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 195 00000100:00100000:2.0:1789135996.200005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.200315:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696083328 00000100:00100000:3.0:1789135996.200326:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696083328 00000100:00100000:3.0:1789135996.200384:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 196 00000100:00100000:3.0:1789135996.200393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11796:x1876044696083328:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135996.200480:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.200499:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.200510:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.200546:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.200558:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 34 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.200587:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723342720:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135996.200686:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135996.204223:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723342720:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135996.204260:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.204507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.205555:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696083584 00000100:00100000:3.0:1789135996.205568:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696083584 00000100:00100000:3.0:1789135996.205648:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 52 00000100:00100000:3.0:1789135996.205658:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:5608:x1876044696083584:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789135996.206101:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:5608:x1876044696083584:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 435us (1587us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789135996.206110:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 52 00000100:00100000:0.0:1789135996.210125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.210319:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696083712 00000100:00100000:3.0:1789135996.210331:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696083712 00010000:00010000:3.0:1789135996.210386:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 36 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.210433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:3.0:1789135996.210444:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:2364:x1876044696083712:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135996.210461:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135996.210468:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 36 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210515:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 36 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630222 expref: 36 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210562:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135996.210568:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210579:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210587:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.210616:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135996.210691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:2364:x1876044696083712:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 249us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.210735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 80 00010000:00010000:1.0:1789135996.212508:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212525:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212570:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212578:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212586:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212616:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135996.212622:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212629:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212645:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:1.0:1789135996.212648:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135996.212654:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.212661:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.212823:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11796:x1876044696083328:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 12423us (12823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135996.212836:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 196 00000100:00100000:0.0:1789135996.216766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.217031:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696083968 00000100:00100000:3.0:1789135996.217043:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696083968 00000100:00100000:3.0:1789135996.218048:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:3.0:1789135996.218069:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+34:11796:x1876044696083968:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135996.218365:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11796:x1876044696083968:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 304us (1621us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789135996.218376:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:0.0:1789135996.338677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.340950:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696084224 00000100:00100000:2.0:1789135996.340965:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696084224 00000100:00100000:2.0:1789135996.341214:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 197 00000100:00100000:2.0:1789135996.341226:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+35:11807:x1876044696084224:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:2.0:1789135996.341253:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.341276:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63023e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341355:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341371:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341383:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341525:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341535:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341542:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341922:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341933:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.341939:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135996.341950:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789135996.342373:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342382:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342389:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342395:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.342399:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342470:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342485:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135996.342487:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135996.342493:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342499:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342513:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342518:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342523:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342528:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.342530:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342535:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342541:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2f00) 00010000:00010000:2.0:1789135996.342544:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135996.342546:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342561:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342671:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63023e expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342688:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63023e expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.342695:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:2.0:1789135996.342697:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135996.342767:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936800, rc 0) 00000100:00100000:2.0:1789135996.342855:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:11807:x1876044696084224:12345-192.168.204.41@tcp:101:cat.0 Request processed in 1631us (4188us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789135996.342863:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 197 00000100:00100000:2.0:1789135996.359753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135996.360014:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696084480 00000100:00100000:1.0:1789135996.360025:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696084480 00000100:00100000:1.0:1789135996.360098:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:1.0:1789135996.360110:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:11807:x1876044696084480:12345-192.168.204.41@tcp:35:cat.0 00000100:00100000:1.0:1789135996.360391:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11807:x1876044696084480:12345-192.168.204.41@tcp:35:cat.0 Request processed in 281us (687us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789135996.360399:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 54 00000100:00100000:1.0:1789135996.414694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.416501:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696084736 00000100:00100000:3.0:1789135996.416524:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696084736 00000100:00100000:3.0:1789135996.416635:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 198 00000100:00100000:3.0:1789135996.416649:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11808:x1876044696084736:12345-192.168.204.41@tcp:36:rm.0 00010000:00010000:3.0:1789135996.417722:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789135996.417782:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936800/0x38eb79866bf96d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63023e expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.417815:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630237 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.417831:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96d1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630229 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.417844:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c1c2700) 00010000:00010000:3.0:1789135996.417860:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135996.418334:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.418356:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.418368:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.418388:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.418395:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.418425:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.420521:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.420546:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.420563:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135996.428575:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789135996.428591:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470302890446ns, next at 471302886273ns, rc = 0 00010000:00010000:2.0:1789135996.428685:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428747:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428773:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428782:0:8031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428797:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428804:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428835:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135996.428863:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428869:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428876:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428881:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.428886:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428893:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428905:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c659700) 00010000:00010000:2.0:1789135996.428908:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789135996.428912:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428918:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96d9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428938:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428950:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428955:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428959:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.428963:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428968:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428976:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135996.428978:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135996.428981:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.428986:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96d8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135996.428996:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005319944b reply state 000000000174ed36 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.429004:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135996.429188:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+37:11808:x1876044696084736:12345-192.168.204.41@tcp:36:rm.0 Request processed in 12537us (14518us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789135996.429197:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 198 00010000:00010000:3.0:1789135996.432516:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135996.432545:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.432560:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789135996.432565:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.432579:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.432611:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ba05c659700) 00010000:00010000:3.0:1789135996.432616:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135996.432623:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.432631:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96da1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.432884:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135996.432887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135996.432889:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135996.433067:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433078:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433086:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433092:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135996.433097:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433104:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433117:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c659b00) 00010000:00010000:0.0:1789135996.433126:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135996.433130:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.433144:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96d93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.541678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.541853:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696084992 00000100:00100000:3.0:1789135996.541864:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696084992 00000100:00100000:3.0:1789135996.541937:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 199 00000100:00100000:3.0:1789135996.541948:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+36:11814:x1876044696084992:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135996.541974:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135996.542001:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96da8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542143:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542159:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542172:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542186:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542192:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542199:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135996.542805:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789135996.542975:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542987:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.542995:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543031:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543039:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543046:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543053:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135996.543058:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543067:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543081:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135996.543084:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135996.543090:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543096:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96daf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135996.543124:0:5852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001591b46f reply state 000000008e2dbe31 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.543134:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135996.543175:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96da8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543190:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.543198:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:3.0:1789135996.543200:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135996.543203:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4400, rc 0) 00000100:00100000:3.0:1789135996.548266:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11814:x1876044696084992:12345-192.168.204.41@tcp:101:bash.0 Request processed in 6304us (6584us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789135996.548285:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 199 00010000:00010000:2.0:1789135996.559103:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559144:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559152:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559159:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5800 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135996.559164:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559174:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559192:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c659700) 00010000:00010000:2.0:1789135996.559196:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135996.559203:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.559211:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96db6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.559999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135996.560112:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696085120 00000100:00100000:0.0:1789135996.560123:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696085120 00000100:00100000:0.0:1789135996.560192:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:0.0:1789135996.560202:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696085120:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:0.0:1789135996.560219:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135996.560239:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63024c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135996.560269:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135996.560291:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=470s v=(0 0) 00010000:00010000:0.0:1789135996.560297:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135996.560307:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.560327:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.560340:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba086377800, rc 0) 00000100:00100000:0.0:1789135996.560402:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2363:x1876044696085120:12345-192.168.204.41@tcp:101:bash.0 Request processed in 201us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.560409:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00080000:1.0:1789135996.560586:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135996.563664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.563878:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696085248 00000100:00100000:2.0:1789135996.563897:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696085248 00000100:00100000:2.0:1789135996.563955:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:2.0:1789135996.563966:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:11814:x1876044696085248:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135996.563985:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.564006:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630253 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.564084:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.564108:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135996.564113:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135996.564120:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.564163:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.564176:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.564191:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8442:1876044723342848:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135996.564294:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135996.573501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.573935:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8442:1876044723342848:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135996.573972:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.573994:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937c00, rc 0) 00000100:00100000:2.0:1789135996.574070:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:11814:x1876044696085248:12345-192.168.204.41@tcp:101:bash.0 Request processed in 10106us (10414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135996.574080:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:0.0:1789135996.574971:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696085376 00000100:00100000:0.0:1789135996.574991:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696085376 00010000:00010000:0.0:1789135996.575034:0:6713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135996.575085:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:0.0:1789135996.575104:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696085376:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135996.575120:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135996.575146:0:6713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.575161:0:6713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.575185:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4267ea3/0x38eb79866bf96dcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63024c expref: 7 pid: 6700 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.575200:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135996.575205:0:6713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135996.575213:0:6713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.575224:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135996.575262:0:6713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135996.575288:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eed2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6713:1876044723342976:192.168.204.41@tcp:105: 00000100:00100000:0.0:1789135996.575367:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135996.586665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.586838:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696085632 00000100:00100000:3.0:1789135996.586850:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696085632 00000100:00100000:3.0:1789135996.586923:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:3.0:1789135996.586934:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+38:11814:x1876044696085632:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:3.0:1789135996.587337:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11814:x1876044696085632:12345-192.168.204.41@tcp:35:bash.0 Request processed in 403us (681us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789135996.587347:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 55 00000100:00100000:0.0:1789135996.588451:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eed2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6713:1876044723342976:192.168.204.41@tcp:105: 00010000:00010000:0.0:1789135996.588478:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135996.588522:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2364:x1876044696085376:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 13420us (15033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.588533:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 81 00010000:00010000:0.0:1789135996.751213:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135996.830005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.830132:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696085760 00000100:00100000:3.0:1789135996.830147:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696085760 00000100:00100000:3.0:1789135996.830260:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 200 00000100:00100000:3.0:1789135996.830274:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+39:11830:x1876044696085760:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135996.830309:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135996.830339:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63025a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830433:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830451:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830466:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135996.830552:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789135996.830557:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135996.830586:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830618:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63025a expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830640:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63025a expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.830650:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135996.830654:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135996.830659:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135996.830830:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11830:x1876044696085760:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 560us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.830847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 200 00000100:00100000:3.0:1789135996.840689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.847420:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086016 00000100:00100000:2.0:1789135996.847443:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086016 00000100:00100000:2.0:1789135996.847663:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 201 00000100:00100000:2.0:1789135996.847677:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+40:11830:x1876044696086016:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135996.847725:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.847768:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96de7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630261 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.848063:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.848082:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.848096:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135996.848111:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135996.848282:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96de7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630261 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.848304:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630261 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.848315:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:2.0:1789135996.848319:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135996.848323:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936400, rc 0) 00000100:00100000:2.0:1789135996.848419:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11830:x1876044696086016:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 745us (7747us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789135996.851658:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 201 00000100:00100000:0.0:1789135996.858365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135996.858424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.858680:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086272 00000100:00100000:2.0:1789135996.858696:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086272 00000100:00100000:2.0:1789135996.858817:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 202 00000100:00100000:2.0:1789135996.858829:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+42:11830:x1876044696086272:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135996.858872:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135996.858903:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96dfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630268 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.859041:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.859059:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.859073:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135996.859090:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135996.859264:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96dfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630268 expref: 45 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.859285:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630268 expref: 44 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.859295:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:2.0:1789135996.859298:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135996.859303:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936000, rc 0) 00000100:00100000:2.0:1789135996.859411:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+44:11830:x1876044696086272:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 584us (1063us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789135996.859420:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 202 00000100:00100000:3.0:1789135996.859738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086400 00000100:00100000:3.0:1789135996.859756:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086400 00000100:00100000:3.0:1789135996.859813:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:3.0:1789135996.859823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059224050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+44:2364:x1876044696086400:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135996.859836:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135996.859856:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630261 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.859882:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:3.0:1789135996.859886:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135996.859915:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059224050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+43:2364:x1876044696086400:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 94us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.859921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:1.0:1789135996.872060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.872219:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086528 00000100:00100000:2.0:1789135996.872236:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086528 00000100:00100000:2.0:1789135996.872332:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:2.0:1789135996.872345:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+6:2366:x1876044696086528:12345-192.168.204.41@tcp:1:lfs.0 00010000:00010000:2.0:1789135996.872412:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.872440:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.872451:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135996.872456:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135996.872462:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.872508:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.872524:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 6 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.872543:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723343104:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135996.872679:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135996.879688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135996.879830:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086656 00000100:00100000:1.0:1789135996.879843:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086656 00002000:00100000:1.0:1789135996.879931:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ba072eee1c0 x1876044696086656/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:427/0 lens 504/0 e 0 to 0 dl 1789136007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135996.879946:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba072eee1c0 with x1876044696086656 ext(0->8) 00010000:00010000:1.0:1789135996.879959:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 7 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.879979:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 7 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135996.879988:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba072eee1c0 00000100:00100000:1.0:1789135996.880023:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789135996.880036:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696086656:12345-192.168.204.41@tcp:4:lfs.0 00000100:00100000:1.0:1789135996.880837:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2364:x1876044696086656:12345-192.168.204.41@tcp:4:lfs.0 Request processed in 798us (1159us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789135996.880849:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00002000:00100000:1.0:1789135996.880860:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ba072eee1c0 x1876044696086656/t4294967308(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:427/0 lens 504/448 e 0 to 0 dl 1789136007 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135996.880869:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba072eee1c0 with x1876044696086656 ext(0->8) 00010000:00010000:1.0:1789135996.880876:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.880905:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135996.880914:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ba072eee1c0 00000100:00100000:2.0:1789135996.881179:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6700:1876044723343104:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135996.881211:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.890481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.890617:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696086784 00000100:00100000:2.0:1789135996.890630:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696086784 00010000:00010000:2.0:1789135996.890691:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135996.890788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 82 00000100:00100000:2.0:1789135996.890799:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2366:x1876044696086784:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135996.890819:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789135996.890843:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789135996.890846:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135995 00002000:00010000:2.0:1789135996.890849:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789135995 00002000:00010000:2.0:1789135996.890851:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789135995 00010000:00010000:2.0:1789135996.890873:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.890888:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.890916:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf96dd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630253 expref: 9 pid: 8442 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.890937:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135996.890960:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135996.890967:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.890979:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135996.891029:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135996.891107:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2366:x1876044696086784:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 309us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135996.891117:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 82 00010000:00010000:3.0:1789135996.891681:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891735:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891792:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891805:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891833:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891842:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789135996.891847:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891861:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891878:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.891887:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667fc3fb/0x38eb79866bf96e11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.892460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696086528:12345-192.168.204.41@tcp:1:lfs.0 Request processed in 20111us (20413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.892472:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:1.0:1789135996.896396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.896512:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087040 00000100:00100000:3.0:1789135996.896526:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087040 00000100:00100000:3.0:1789135996.896607:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 56 00000100:00100000:3.0:1789135996.896619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba045f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+43:11830:x1876044696087040:12345-192.168.204.41@tcp:35:lfs.0 00000004:00010000:3.0:1789135996.896759:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630268 expref: 43 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135996.897641:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789135996.897692:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789135996.903092:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789135996.903239:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.903266:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.903278:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.903334:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.903354:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 47 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135996.903388:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876044723343232:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135996.907431:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135996.913024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.913310:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1876044723343232:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135996.913348:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.914181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087168 00000100:00100000:1.0:1789135996.914199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087168 00010000:00010000:1.0:1789135996.914257:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 48 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.914316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:1.0:1789135996.914328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+48:2363:x1876044696087168:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135996.914348:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135996.914355:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 48 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914369:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 48 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914397:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630245 expref: 48 pid: 5852 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914415:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:1.0:1789135996.914420:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914446:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914455:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.914484:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135996.914565:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+47:2363:x1876044696087168:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 240us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135996.914574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 83 00010000:00010000:3.0:1789135996.916002:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.916021:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135996.916807:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789135996.917300:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789135996.917480:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876044723343360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789135996.917576:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135996.917634:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135996.918065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723343360 00000100:00100000:0.0:1789135996.918075:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723343360 00000100:00100000:0.0:1789135996.918170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135996.918182:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876044723343360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789135996.918226:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135996.918305:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876044723343360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.918314:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789135996.918421:0:5853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789135996.918428:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789135996.918452:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba0580c0780, transno 4294967307 00000100:00100000:1.0:1789135996.918525:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876044723343360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789135996.919174:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789135996.919272:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876044723343488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789135996.919331:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135996.919368:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135996.919599:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723343488 00000100:00100000:3.0:1789135996.919607:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723343488 00000100:00100000:3.0:1789135996.919662:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135996.919672:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1876044723343488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135996.923569:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1876044723343488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 3882us (4220us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789135996.923587:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135996.923821:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1876044723343488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789135996.924244:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789135996.924325:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924338:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924347:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924428:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135996.924434:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924444:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924469:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:1.0:1789135996.924473:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789135996.924480:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135996.924487:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96e18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135996.925496:0:5853:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789135996.925641:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789135996.925658:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470799956952ns, next at 471799953322ns, rc = 0 00000001:00080000:1.0:1789135996.925670:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789135996.925772:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659900) 00010000:00010000:1.0:1789135996.925776:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789135996.925789:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630268 expref: 51 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135996.927336:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba045f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:11830:x1876044696087040:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 30707us (30946us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789135996.927352:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 56 00000020:00080000:1.0:1789135996.927361:0:5853:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789135996.939234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135996.945264:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087296 00000100:00100000:3.0:1789135996.945287:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087296 00000100:00100000:3.0:1789135996.945479:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 203 00000100:00100000:3.0:1789135996.945492:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+50:11830:x1876044696087296:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135996.945526:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135996.945554:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96e1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63026f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.945633:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96e1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63026f expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.945652:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96e1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63026f expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135996.945673:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135996.945677:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135996.945682:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135996.945827:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+51:11830:x1876044696087296:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 337us (6615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.945834:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 203 00000100:00100000:0.0:1789135996.957920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135996.959668:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087552 00000100:00100000:2.0:1789135996.959694:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087552 00000100:00100000:2.0:1789135996.959863:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 57 00000100:00100000:2.0:1789135996.959877:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+51:11830:x1876044696087552:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:2.0:1789135996.961771:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:11830:x1876044696087552:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 1884us (3867us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789135996.961787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 57 00000040:00080000:2.0:1789135997.009770:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135997.009784:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135997.009828:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789135997.009836:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135997.056448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135997.057088:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087680 00000100:00100000:2.0:1789135997.057106:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087680 00000100:00100000:2.0:1789135997.057287:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00100000:2.0:1789135997.057301:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:11840:x1876044696087680:12345-192.168.204.41@tcp:34:lfs.0 00010000:00010000:2.0:1789135997.057434:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057470:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057497:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057521:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057529:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057536:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057694:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057725:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057733:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135997.057799:0:8031:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057825:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057840:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057848:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057855:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135997.057860:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057869:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057885:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135997.057889:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135997.057896:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057906:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057922:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057929:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057937:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057942:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135997.057950:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057957:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057965:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2f00) 00010000:00010000:2.0:1789135997.057968:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135997.057971:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057978:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057993:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.057999:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.058005:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.058010:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135997.058014:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.058019:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.058025:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135997.058026:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135997.058034:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.058040:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135997.058622:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:11840:x1876044696087680:12345-192.168.204.41@tcp:34:lfs.0 Request processed in 1316us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135997.058635:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00080000:1.0:1789135997.060149:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135997.101025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135997.101176:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696087936 00000100:00100000:2.0:1789135997.101190:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696087936 00000100:00100000:2.0:1789135997.101314:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 205 00000100:00100000:2.0:1789135997.101327:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+52:11843:x1876044696087936:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135997.101357:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135997.101388:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630276 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101490:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101510:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101524:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101543:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101551:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101558:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101834:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101844:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.101852:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135997.101874:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135997.102013:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102021:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102029:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102035:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135997.102039:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102048:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102063:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135997.102066:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135997.102072:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102089:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf96e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102108:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102114:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102121:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102126:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135997.102130:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102136:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102145:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2f00) 00010000:00010000:2.0:1789135997.102147:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135997.102150:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102156:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102206:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630276 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102221:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630276 expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.102235:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135997.102238:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135997.102241:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936400, rc 0) 00000100:00100000:2.0:1789135997.102333:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:11843:x1876044696087936:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1008us (1326us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789135997.102343:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 205 00000100:00100000:2.0:1789135997.106045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135997.106194:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696088064 00000100:00100000:0.0:1789135997.106207:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696088064 00000100:00100000:0.0:1789135997.106293:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 206 00000100:00100000:0.0:1789135997.106307:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:11843:x1876044696088064:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:0.0:1789135997.106420:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106442:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106458:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106496:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106504:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106511:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106519:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba086377200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135997.106524:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106534:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106551:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789135997.106554:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135997.106580:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.106587:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377200/0x38eb79866bf96e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135997.106751:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:11843:x1876044696088064:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 394us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135997.106762:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 206 00000100:00100000:1.0:1789135997.110892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.110998:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696088320 00000100:00100000:3.0:1789135997.111011:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696088320 00000100:00100000:3.0:1789135997.111093:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 58 00000100:00100000:3.0:1789135997.111104:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+54:11843:x1876044696088320:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:3.0:1789135997.111441:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:11843:x1876044696088320:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 337us (562us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789135997.111450:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 58 00000100:00100000:1.0:1789135997.236845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.237166:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696088576 00000100:00100000:3.0:1789135997.237181:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696088576 00000100:00100000:3.0:1789135997.237262:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 207 00000100:00100000:3.0:1789135997.237274:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+55:11853:x1876044696088576:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789135997.237307:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135997.237310:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135997.237352:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63025a expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.237391:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135997.237398:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135997.237415:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96e65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63027d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.237957:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.237977:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.238007:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135997.238021:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789135997.238653:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96e65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63027d expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.238680:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63027d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.238847:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135997.238851:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135997.238855:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789135997.239020:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:11853:x1876044696088576:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1746us (2190us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789135997.239029:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 207 00000100:00100000:2.0:1789135997.259403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135997.259877:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696088832 00000100:00100000:1.0:1789135997.259890:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696088832 00000100:00100000:1.0:1789135997.259967:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 208 00000100:00100000:1.0:1789135997.259979:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+56:11853:x1876044696088832:12345-192.168.204.41@tcp:36:bash.0 00010000:00010000:1.0:1789135997.260062:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789135997.260099:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63027d expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.260124:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936400/0x38eb79866bf96e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630276 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.260138:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:1.0:1789135997.260145:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135997.260631:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.260761:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.260775:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135997.260847:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789135997.260878:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f0737d84 reply state 00000000dd208757 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135997.260908:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135997.261058:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:11853:x1876044696088832:12345-192.168.204.41@tcp:36:bash.0 Request processed in 1079us (1668us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789135997.261068:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 208 00000020:00080000:1.0:1789135997.261074:0:8031:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789135997.265870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135997.265963:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696088960 00000100:00100000:2.0:1789135997.265977:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696088960 00000100:00100000:2.0:1789135997.266066:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 209 00000100:00100000:2.0:1789135997.266079:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:11853:x1876044696088960:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789135997.266112:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135997.266154:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630284 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.266265:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.266280:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.266290:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.266313:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.266350:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267025:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267048:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267055:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267061:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135997.267066:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267075:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267094:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789135997.267098:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135997.267101:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267111:0:3298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267242:0:3298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267280:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.267289:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf96e7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.267357:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.267365:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135997.267413:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789135997.267418:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135997.267445:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.267487:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936000/0x38eb79866bf96e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.267504:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.267521:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135997.267525:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135997.267528:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937c00, rc 0) 00000100:00100000:2.0:1789135997.267618:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:11853:x1876044696088960:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1541us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135997.267633:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 209 00000100:00100000:0.0:1789135997.274951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.275224:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089216 00000100:00100000:3.0:1789135997.275239:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089216 00000100:00100000:3.0:1789135997.275353:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:3.0:1789135997.275365:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+57:11853:x1876044696089216:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:3.0:1789135997.276069:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+58:11853:x1876044696089216:12345-192.168.204.41@tcp:35:bash.0 Request processed in 703us (1133us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789135997.276080:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 59 00000100:00100000:0.0:1789135997.338825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.338953:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089344 00000100:00100000:3.0:1789135997.338968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089344 00000100:00100000:3.0:1789135997.339037:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 210 00000100:00100000:3.0:1789135997.339062:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+58:11859:x1876044696089344:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135997.339087:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135997.339110:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63028b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339178:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339193:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339205:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135997.339266:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789135997.339271:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135997.339306:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339331:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63028b expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339348:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63028b expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.339356:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135997.339359:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135997.339363:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135997.339468:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696089344:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 408us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135997.339485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 210 00000100:00100000:1.0:1789135997.344191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.344357:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089472 00000100:00100000:3.0:1789135997.344368:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089472 00000100:00100000:3.0:1789135997.344542:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 211 00000100:00100000:3.0:1789135997.344552:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696089472:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135997.344573:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135997.344597:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630292 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344662:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344690:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344728:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344754:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344761:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.344768:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345198:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345224:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345231:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135997.345268:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789135997.345272:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135997.345412:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345425:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345556:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345562:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345569:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345575:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135997.345579:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345587:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345600:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135997.345603:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135997.345616:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345622:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf96ea4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.345636:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348188:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348203:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348209:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135997.348214:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348224:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348242:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c659d00) 00010000:00010000:3.0:1789135997.348245:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135997.348250:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348257:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4400/0x38eb79866bf96eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348385:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96e9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630292 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348550:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630292 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.348561:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135997.348564:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135997.348567:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:3.0:1789135997.348641:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11859:x1876044696089472:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 4088us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135997.348651:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 211 00000100:00100000:2.0:1789135997.354293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135997.354336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135997.354424:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089728 00000100:00100000:3.0:1789135997.354434:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089728 00000100:00100000:0.0:1789135997.354476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089856 00000100:00100000:0.0:1789135997.354481:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089856 00000100:00100000:3.0:1789135997.354488:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 212 00000100:00100000:3.0:1789135997.354497:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11859:x1876044696089728:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:3.0:1789135997.354514:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135997.354535:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630299 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135997.354655:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:2.0:1789135997.354664:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+62:2365:x1876044696089856:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135997.354680:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135997.354791:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5800/0x38eb79866bf96eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630292 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.354808:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135997.354813:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135997.354872:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:2365:x1876044696089856:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 210us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135997.354880:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00010000:00010000:3.0:1789135997.355225:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.355241:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.355249:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.355336:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.355360:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 60 pid: 5850 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135997.355374:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723343616:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135997.355439:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135997.363930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135997.364083:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723343616:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789135997.364110:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135997.364238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696089984 00000100:00100000:3.0:1789135997.364246:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696089984 00010000:00010000:3.0:1789135997.364286:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 61 pid: 5850 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135997.364330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:3.0:1789135997.364340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:2364:x1876044696089984:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135997.364356:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135997.364364:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 61 pid: 5850 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364376:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 61 pid: 5850 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364399:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf96e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630284 expref: 61 pid: 5850 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135997.364419:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364449:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364456:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135997.364494:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135997.364632:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:2364:x1876044696089984:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 291us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135997.364640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 84 00010000:00010000:2.0:1789135997.364774:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.364783:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135997.364802:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789135997.364959:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.364976:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.364983:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135997.364985:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135997.364988:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0862cc800, rc 0) 00000100:00100000:2.0:1789135997.365014:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11859:x1876044696089728:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 10519us (10733us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789135997.365027:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 212 00000100:00100000:2.0:1789135997.375148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135997.376818:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696090240 00000100:00100000:0.0:1789135997.376833:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696090240 00000100:00100000:0.0:1789135997.377060:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:0.0:1789135997.377073:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11859:x1876044696090240:12345-192.168.204.41@tcp:103:lfs.0 00010000:00010000:0.0:1789135997.377092:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135997.377117:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96e1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63026f expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135997.377136:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789135997.377141:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135997.377214:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696090240:12345-192.168.204.41@tcp:103:lfs.0 Request processed in 143us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135997.377596:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:0.0:1789135997.379322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135997.379425:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696090368 00000100:00100000:2.0:1789135997.379433:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696090368 00000100:00100000:2.0:1789135997.379486:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 213 00000100:00100000:2.0:1789135997.379496:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696090368:12345-192.168.204.41@tcp:58:lfs.0 00010000:00010000:2.0:1789135997.379619:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.379636:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135997.379647:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135997.379930:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789135997.380207:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696090368:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 709us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135997.380216:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 213 00000100:00100000:2.0:1789135997.390602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135997.390804:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696090496 00000100:00100000:1.0:1789135997.390815:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696090496 00000100:00100000:1.0:1789135997.390980:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 214 00000100:00100000:1.0:1789135997.390992:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+59:11859:x1876044696090496:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135997.391018:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135997.391046:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302a0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391113:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391125:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391146:0:8031:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391179:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391193:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:1.0:1789135997.391196:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135997.391200:0:8031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.391210:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7000, rc 0) 00000100:00100000:1.0:1789135997.391286:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11859:x1876044696090496:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 296us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135997.391294:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 214 00010000:00010000:3.0:1789135997.773026:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135998.029060:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135998.029069:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135998.029100:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789135998.029107:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135998.029216:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723343744:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135998.029313:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135998.036525:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723343744:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135998.039559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.039793:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696090624 00000100:00100000:3.0:1789135998.039803:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696090624 00000100:00100000:3.0:1789135998.039874:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 215 00000100:00100000:3.0:1789135998.039886:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11860:x1876044696090624:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135998.039922:0:5852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135998.040061:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11860:x1876044696090624:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 176us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.040069:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 215 00000100:00100000:2.0:1789135998.051435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.051525:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696090752 00000100:00100000:1.0:1789135998.051535:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696090752 00000100:00100000:1.0:1789135998.051601:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 216 00000100:00100000:1.0:1789135998.051612:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11860:x1876044696090752:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.051693:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051761:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051774:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051792:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051828:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051868:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051888:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051896:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135998.051935:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789135998.051940:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135998.051954:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051966:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051973:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051980:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.051986:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135998.051989:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052003:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052017:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:1.0:1789135998.052020:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135998.052025:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052030:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96edc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052043:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052049:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052054:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052059:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135998.052061:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052067:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052073:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8ba069d75800) 00010000:00010000:1.0:1789135998.052075:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135998.052077:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052093:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96ee3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052108:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052114:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052120:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052125:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135998.052128:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052134:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052151:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:1.0:1789135998.052154:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135998.052157:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.052163:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf96eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.052359:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11860:x1876044696090752:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 Request processed in 747us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135998.052369:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 216 00000100:00100000:1.0:1789135998.064282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.064962:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696091008 00000100:00100000:3.0:1789135998.064975:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696091008 00000100:00100000:3.0:1789135998.065053:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 217 00000100:00100000:3.0:1789135998.065065:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+60:11860:x1876044696091008:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135998.065092:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135998.065122:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ef1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302a7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065236:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065252:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065267:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135998.065280:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789135998.065395:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065403:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065411:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065418:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135998.065423:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065431:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065444:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135998.065447:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135998.065452:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065469:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065516:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ef1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a7 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065528:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:3.0:1789135998.065531:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135998.065536:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96ef1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a7 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.065545:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135998.065611:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091008:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 549us (1341us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1789135998.065620:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 217 00000100:00100000:2.0:1789135998.073056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.073173:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696091136 00000100:00100000:1.0:1789135998.073183:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696091136 00000100:00100000:1.0:1789135998.073242:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 218 00000100:00100000:1.0:1789135998.073253:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091136:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789135998.073288:0:5851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789135998.073400:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091136:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 147us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135998.073407:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 218 00000100:00100000:0.0:1789135998.081285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.081942:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696091392 00000100:00100000:3.0:1789135998.081951:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696091392 00000100:00100000:3.0:1789135998.082018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 219 00000100:00100000:3.0:1789135998.082028:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091392:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135998.082049:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135998.082052:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135998.082080:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63028b expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082100:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:3.0:1789135998.082106:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135998.082137:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f06 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302ae expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135998.082578:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789135998.082868:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082883:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082894:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082951:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ae expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082968:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ae expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.082976:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659d00) 00010000:00010000:3.0:1789135998.082979:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135998.082982:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789135998.083057:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+62:11860:x1876044696091392:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 1030us (1781us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789135998.083066:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 219 00000100:00100000:2.0:1789135998.090425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.091174:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696091648 00000100:00100000:1.0:1789135998.091185:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696091648 00000100:00100000:1.0:1789135998.091237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 220 00000100:00100000:1.0:1789135998.091248:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+62:11860:x1876044696091648:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.091308:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135998.091335:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf96f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ae expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091355:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659d00) 00010000:00010000:1.0:1789135998.091365:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135998.091383:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091396:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091405:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091428:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091452:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091460:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091537:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091544:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091551:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091557:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135998.091561:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091568:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091575:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:1.0:1789135998.091578:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135998.091581:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091587:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091595:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091606:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091612:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091616:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789135998.091619:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091624:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091631:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x537fc8e3 (ffff8ba069d75800) 00010000:00010000:1.0:1789135998.091633:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135998.091635:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.091641:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6c00/0x38eb79866bf96f22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x537fc8e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.091765:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091648:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 519us (1350us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135998.091772:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 220 00000100:00100000:1.0:1789135998.100865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.101122:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696091776 00000100:00100000:3.0:1789135998.101136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696091776 00000100:00100000:3.0:1789135998.101218:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 221 00000100:00100000:3.0:1789135998.101229:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696091776:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135998.101272:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135998.101299:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302b5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101339:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101353:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101382:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101514:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101537:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.101546:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:3.0:1789135998.101549:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135998.101554:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789135998.101631:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+62:11860:x1876044696091776:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 404us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.101639:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 221 00000100:00100000:0.0:1789135998.121048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.121161:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092032 00000100:00100000:1.0:1789135998.121172:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092032 00000100:00100000:1.0:1789135998.121259:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 222 00000100:00100000:1.0:1789135998.121276:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+62:11860:x1876044696092032:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.121409:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.121432:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.121462:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135998.122041:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789135998.122062:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471996360597ns, next at 472996354690ns, rc = 0 00000004:00010000:1.0:1789135998.122238:0:8031:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000538f701c reply state 00000000109371aa transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.122760:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135998.123180:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+64:11860:x1876044696092032:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 1905us (2142us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789135998.123190:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 222 00010000:00010000:2.0:1789135998.126911:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126932:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126940:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126947:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135998.126952:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126961:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126981:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:2.0:1789135998.126985:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789135998.126990:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.126997:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96f37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135998.133367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.135002:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092160 00000100:00100000:1.0:1789135998.135017:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092160 00000100:00100000:1.0:1789135998.135350:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 223 00000100:00100000:1.0:1789135998.135375:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+63:11860:x1876044696092160:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.135401:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135998.135439:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302bc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.135503:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.135661:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.135685:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:1.0:1789135998.135690:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135998.135693:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7600, rc 0) 00000100:00100000:1.0:1789135998.135802:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+64:11860:x1876044696092160:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 442us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135998.135811:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 223 00000100:00100000:1.0:1789135998.142329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.142422:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092288 00000100:00100000:3.0:1789135998.142442:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092288 00000100:00100000:3.0:1789135998.142517:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00100000:3.0:1789135998.142529:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696092288:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789135998.143059:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2363:x1876044696092288:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 532us (740us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789135998.143069:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00080000:1.0:1789135998.143139:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135998.145918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.146086:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092544 00000100:00100000:2.0:1789135998.146098:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092544 00000100:00100000:2.0:1789135998.146167:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:2.0:1789135998.146176:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+64:11860:x1876044696092544:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135998.146441:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+65:11860:x1876044696092544:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 264us (531us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789135998.146467:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 60 00000100:00100000:0.0:1789135998.154773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.154877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092800 00000100:00100000:2.0:1789135998.154886:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092800 00000100:00100000:2.0:1789135998.154936:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 224 00000100:00100000:2.0:1789135998.154945:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+65:11860:x1876044696092800:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135998.155060:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+65:11860:x1876044696092800:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.155068:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 224 00000100:00100000:1.0:1789135998.163028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.164667:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696092928 00000100:00100000:2.0:1789135998.164681:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696092928 00000100:00100000:2.0:1789135998.164801:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 225 00000100:00100000:2.0:1789135998.164814:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+65:11860:x1876044696092928:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135998.164841:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135998.164866:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96f45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302c3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.164945:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.164959:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.164971:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135998.165010:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135998.165030:0:5850:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.165072:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96f45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302c3 expref: 67 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.165090:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302c3 expref: 66 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.165098:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:2.0:1789135998.165101:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789135998.165105:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937a00, rc 0) 00000100:00100000:2.0:1789135998.165165:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+66:11860:x1876044696092928:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 353us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.165172:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 225 00000100:00100000:3.0:1789135998.171319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.171738:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093056 00000100:00100000:2.0:1789135998.171749:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093056 00000100:00100000:2.0:1789135998.171912:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:2.0:1789135998.171923:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+10:2364:x1876044696093056:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135998.171943:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135998.171964:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302ca expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135998.171994:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c7d, blocks: 0x1 00010000:00010000:2.0:1789135998.172040:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789135998.172045:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135998.172056:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.172088:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.172102:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937600, rc 0) 00000100:00100000:2.0:1789135998.172176:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2364:x1876044696093056:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 253us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.172186:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:0.0:1789135998.176909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.176990:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093312 00000100:00100000:2.0:1789135998.177001:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093312 00000100:00100000:2.0:1789135998.177064:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 226 00000100:00100000:2.0:1789135998.177074:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+66:11860:x1876044696093312:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135998.177198:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+66:11860:x1876044696093312:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.177207:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 226 00000100:00100000:1.0:1789135998.182322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.182418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093440 00000100:00100000:3.0:1789135998.182427:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093440 00000100:00100000:3.0:1789135998.182490:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:3.0:1789135998.182501:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:11860:x1876044696093440:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135998.182522:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135998.182555:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302d1 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.182588:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.182599:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135998.182603:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135998.182609:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.182646:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.182659:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.182695:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723343872:192.168.204.41@tcp:104: 00000100:00100000:3.0:1789135998.183142:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135998.207298:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723343872:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789135998.207344:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.207369:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789135998.207434:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:11860:x1876044696093440:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 24935us (25128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.207444:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:0.0:1789135998.221323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.224615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093568 00000100:00100000:1.0:1789135998.224633:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093568 00010000:00010000:1.0:1789135998.224690:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.224789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:1.0:1789135998.224800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+12:2363:x1876044696093568:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135998.224820:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135998.224859:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.224874:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.224925:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000048d7389/0x38eb79866bf96f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ca expref: 12 pid: 6698 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.224943:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135998.224948:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135998.224957:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.224968:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.225007:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.225021:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723344000:192.168.204.41@tcp:105: 00000100:00100000:1.0:1789135998.225112:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135998.233306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.233494:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1876044723344000:192.168.204.41@tcp:105: 00010000:00010000:3.0:1789135998.233520:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135998.233594:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2363:x1876044696093568:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 8794us (12282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.233606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:2.0:1789135998.234041:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093696 00000100:00100000:2.0:1789135998.234048:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093696 00002000:00100000:2.0:1789135998.234097:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ba072f1c000 x1876044696093696/t0(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:429/0 lens 504/0 e 0 to 0 dl 1789136009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135998.234109:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba072f1c000 with x1876044696093696 ext(0->12) 00002000:00010000:2.0:1789135998.234114:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba072f1c000 00000100:00100000:2.0:1789135998.234144:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:2.0:1789135998.234154:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+11:2363:x1876044696093696:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789135998.234874:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696093696:12345-192.168.204.41@tcp:4:lhsmtool_posix.0 Request processed in 719us (1576us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789135998.234952:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00002000:00100000:2.0:1789135998.234960:0:6705:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ba072f1c000 x1876044696093696/t4294967320(0) o4->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:429/0 lens 504/448 e 0 to 0 dl 1789136009 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135998.234969:0:6705:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba072f1c000 with x1876044696093696 ext(0->12) 00002000:00010000:2.0:1789135998.234973:0:6705:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba072f1c000 00000100:00100000:1.0:1789135998.240100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.240202:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093824 00000100:00100000:3.0:1789135998.240212:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093824 00000100:00100000:3.0:1789135998.240275:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 227 00000100:00100000:3.0:1789135998.240287:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+66:11860:x1876044696093824:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789135998.302549:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967469 is committed 00000001:00080000:0.0:1789135998.302571:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000100:00100000:3.0:1789135998.303031:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+61:11860:x1876044696093824:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 Request processed in 62739us (62935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.303044:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 227 00000004:00080000:0.0:1789135998.303116:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1789135998.303135:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789135998.303157:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba07261a540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789135998.303161:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba045594100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba07261a840 00000020:00080000:0.0:1789135998.303164:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba045594200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba073790000 00000001:00080000:0.0:1789135998.303186:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000100:00100000:2.0:1789135998.303618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723344128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789135998.303668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789135998.303803:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ba07c118180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789135998.303807:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e7e100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ba07c118f00 00000020:00080000:0.0:1789135998.303811:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba072e7e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba072edb000 00000100:00100000:1.0:1789135998.303829:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723344128 00000100:00100000:1.0:1789135998.303838:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723344128 00000004:00080000:0.0:1789135998.303907:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789135998.303941:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1789135998.303997:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135998.304020:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723344128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789135998.304048:0:6700:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789135998.304083:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40c7b, atime: 0x6aa40c7b, ctime: 0x6aa40c7b, blocks: 0x1 00010000:00010000:1.0:1789135998.304106:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.304122:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=472s v=(0 0) 00000020:00080000:0.0:1789135998.304123:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1789135998.304127:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135998.304135:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.304151:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.304160:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.304168:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.304192:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135998.304343:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723344256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135998.304390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135998.304421:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135998.304430:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723344384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789135998.304460:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135998.304488:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723344256 00000100:00100000:3.0:1789135998.304492:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723344256 00000100:00100000:3.0:1789135998.304518:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723344384 00000100:00100000:3.0:1789135998.304522:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723344384 00000100:00100000:3.0:1789135998.304543:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135998.304552:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1876044723344256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789135998.304568:0:6697:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1789135998.304587:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.304604:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.304613:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789135998.304616:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135998.304620:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.304650:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 12 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.304665:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 12 pid: 8442 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.304689:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723344512:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135998.304742:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723344128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 693us (1030us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789135998.304751:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135998.304772:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135998.304779:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135998.304781:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07257f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723344384:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789135998.304849:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135998.304857:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.304865:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135998.304870:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.304886:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.304903:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.304911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef52d691/0x38eb79866bf96f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.304928:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135998.304930:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135998.304932:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789135998.305062:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135998.305066:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789135998.305101:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba072f1cf00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789135998.305107:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723344128:0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1789135998.305975:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789135998.305980:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789135997 00002000:00010000:1.0:1789135998.305982:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135998.305984:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789135997 -> 1789135997 00002000:00010000:1.0:1789135998.305995:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789135998.306054:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07257f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1876044723344384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1275us (1592us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789135998.306063:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135998.306203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000004:00080000:3.0:1789135998.306378:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba072d17c00/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789135998.306385:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723344384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789135998.306421:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696093952 00000100:00100000:0.0:1789135998.306427:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696093952 00000100:00100000:0.0:1789135998.306496:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 70 00000100:00100000:0.0:1789135998.306505:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696093952:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789135998.310911:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723344512:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135998.310942:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.324673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.325125:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094080 00000100:00100000:2.0:1789135998.325136:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094080 00010000:00010000:2.0:1789135998.325177:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 14 pid: 8442 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.325216:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 86 00000100:00100000:2.0:1789135998.325226:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+14:2363:x1876044696094080:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135998.325240:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135998.325246:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 14 pid: 8442 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.325260:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 14 pid: 8442 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.325293:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b296f462/0x38eb79866bf96d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630230 expref: 14 pid: 8442 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.325310:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135998.325314:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135998.325319:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.325329:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.325355:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135998.325407:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059225050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+13:2363:x1876044696094080:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 183us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.325415:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 86 00010000:00010000:0.0:1789135998.326113:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.326125:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.326144:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.326151:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.326204:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789135998.326789:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1876044723344256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22236us (22396us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789135998.326798:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1789135998.326959:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba072d143c0/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789135998.326966:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072d143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723344256:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789135998.327524:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135998.327534:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.327545:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135998.327550:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.327560:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.327593:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.327602:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063dd011f/0x38eb79866bf96f68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.327623:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135998.327625:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135998.327627:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789135998.339680:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1789135998.339696:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1789135998.339730:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1789135998.339895:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696093952:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 Request processed in 33384us (33688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135998.339906:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 70 00000100:00100000:1.0:1789135998.346961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.347182:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094336 00000100:00100000:2.0:1789135998.347193:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094336 00000100:00100000:2.0:1789135998.347294:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 228 00000100:00100000:2.0:1789135998.347306:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11860:x1876044696094336:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135998.347362:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135998.347390:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302c3 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.347409:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:2.0:1789135998.347415:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135998.347446:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.347459:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.347484:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135998.347855:0:5851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000584dd305 reply state 00000000b6387c0b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.347865:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135998.347971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:11860:x1876044696094336:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 666us (1020us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789135998.347979:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 228 00010000:00010000:0.0:1789135998.353642:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353658:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353666:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353673:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789135998.353678:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353734:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353754:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:0.0:1789135998.353757:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135998.353762:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.353769:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937e00/0x38eb79866bf96f6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.369560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.369761:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094464 00000100:00100000:3.0:1789135998.369780:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094464 00000100:00100000:3.0:1789135998.369839:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:3.0:1789135998.369849:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696094464:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789135998.370080:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789135998.370084:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789135997 -> 1789135996 00002000:00010000:3.0:1789135998.370086:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789135995 00002000:00010000:3.0:1789135998.370089:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789135997 -> 1789135996 00002000:00010000:3.0:1789135998.370091:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789135998.370148:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696094464:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 300us (599us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789135998.370156:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 71 00000100:00100000:2.0:1789135998.372763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135998.372925:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094720 00000100:00100000:0.0:1789135998.372933:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094720 00000100:00100000:0.0:1789135998.372994:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 229 00000100:00100000:0.0:1789135998.373005:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:11860:x1876044696094720:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135998.373077:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.373095:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.373104:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.373135:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.373148:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 20 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135998.373178:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723344640:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135998.373259:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135998.379582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.379863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094848 00000100:00100000:3.0:1789135998.379871:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094848 00010000:00010000:3.0:1789135998.379908:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.379951:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:3.0:1789135998.379959:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:2364:x1876044696094848:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135998.379986:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135998.379992:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.380005:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.380026:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:3.0:1789135998.380032:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.380041:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.380048:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.380065:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135998.380118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:2364:x1876044696094848:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 159us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.380125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 87 00010000:00010000:2.0:1789135998.381248:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4c00/0x38eb79866bf96f30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302b5 expref: 20 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.381266:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1876044723344640:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135998.381287:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381295:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381301:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381327:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381333:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381356:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381362:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba086377c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135998.381366:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381373:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381385:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:2.0:1789135998.381388:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789135998.381392:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.381399:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba086377c00/0x38eb79866bf96f76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.381646:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11860:x1876044696094720:12345-192.168.204.41@tcp:55:lhsmtool_posix.0 Request processed in 8642us (8890us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789135998.381656:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 229 00000100:00100000:0.0:1789135998.396367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.402952:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696094976 00000100:00100000:1.0:1789135998.402968:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696094976 00000100:00100000:1.0:1789135998.403044:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:1.0:1789135998.403053:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2364:x1876044696094976:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.403099:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.403119:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.403128:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135998.403133:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135998.403138:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.403175:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.403190:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 8 pid: 6697 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.403237:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723344768:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789135998.403339:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135998.412427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.412429:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6697:1876044723344768:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135998.412470:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.413784:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696095104 00000100:00100000:3.0:1789135998.413796:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696095104 00010000:00010000:3.0:1789135998.413849:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 9 pid: 6697 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.413907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:3.0:1789135998.413917:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+9:2363:x1876044696095104:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135998.413949:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135998.413973:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 9 pid: 6697 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.413988:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 9 pid: 6697 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.414014:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbc0914e/0x38eb79866bf96f5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d1 expref: 9 pid: 6697 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.414031:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135998.414036:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135998.414041:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.414050:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.414084:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135998.414149:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696095104:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 233us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.414157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 88 00010000:00010000:2.0:1789135998.415434:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415481:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415513:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415522:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415530:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415537:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789135998.415541:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415550:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415567:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.415575:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055f42ec3/0x38eb79866bf96f7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.415661:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696094976:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 Request processed in 12605us (19301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.415671:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 72 00000100:00100000:3.0:1789135998.426851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.427084:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696095360 00000100:00100000:1.0:1789135998.427094:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696095360 00000100:00100000:1.0:1789135998.427146:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 230 00000100:00100000:1.0:1789135998.427155:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11860:x1876044696095360:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135998.427232:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427250:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427261:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427635:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427646:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427655:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427686:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.427771:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 20 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.427786:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723344896:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789135998.428420:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135998.435182:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723344896:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789135998.435212:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.435251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.435314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696095488 00000100:00100000:1.0:1789135998.435322:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696095488 00010000:00010000:1.0:1789135998.435378:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.435410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:1.0:1789135998.435420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:2364:x1876044696095488:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135998.435945:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135998.435955:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.435969:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.435991:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf96f3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302bc expref: 21 pid: 5852 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.436006:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:1.0:1789135998.436011:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.436019:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.436041:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135998.436067:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135998.436091:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.436101:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135998.436294:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789135998.436456:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789135998.436506:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789135998.436585:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723345024:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135998.436667:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135998.436754:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b9f46e67e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135998.436971:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345024 00000100:00100000:1.0:1789135998.436976:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345024 00000100:00100000:1.0:1789135998.437023:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789135998.437032:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8031:x1876044723345024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789135998.437105:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8031:x1876044723345024:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135998.437113:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135998.439179:0:8031:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1789135998.439191:0:8031:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1789135998.439224:0:8031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba072d17c00, transno 4294967321 00000100:00100000:0.0:1789135998.439256:0:8031:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ba072d143c0 x1876044723344256/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789136014 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135998.439270:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723345024:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789135998.439883:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789135998.439960:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723345152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135998.440017:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135998.440045:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058e8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135998.440728:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345152 00000100:00100000:1.0:1789135998.440736:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345152 00000100:00100000:1.0:1789135998.440795:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135998.440804:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8031:x1876044723345152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789135998.441029:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8031:x1876044723345152:12345-0@lo:1000:mdt00_003.0 Request processed in 224us (1009us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789135998.441037:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135998.441404:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1876044723345152:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789135998.441447:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441470:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441477:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441483:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135998.441488:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441497:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441515:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c659500) 00010000:00010000:3.0:1789135998.441517:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135998.441522:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441529:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf96f8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441563:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441569:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441575:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441580:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135998.441587:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441594:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441602:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135998.441604:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135998.441610:0:8031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441622:0:8031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441631:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.441675:0:8031:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.441871:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a58f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723345280:192.168.204.41@tcp:105: 00000100:00100000:3.0:1789135998.441940:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135998.442485:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+24:2364:x1876044696095488:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 7063us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.442497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:3.0:1789135998.445745:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a58f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1876044723345280:192.168.204.41@tcp:105: 00010000:00010000:3.0:1789135998.445779:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445790:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937000/0x38eb79866bf96ece lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445853:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445868:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445879:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445889:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445895:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445902:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445908:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135998.445912:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445919:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445929:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135998.445932:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135998.445935:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445940:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96f92 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445960:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445966:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445972:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445977:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135998.445979:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445986:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.445993:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135998.445995:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135998.445998:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.446003:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf96f84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.446475:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11860:x1876044696095360:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 19318us (19638us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789135998.446485:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 230 00000020:00080000:3.0:1789135998.446491:0:8031:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789135998.449132:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135998.449140:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135998.449604:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789135998.449613:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135998.452660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.453039:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696095744 00000100:00100000:2.0:1789135998.453049:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696095744 00000100:00100000:2.0:1789135998.453129:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 61 00000100:00100000:2.0:1789135998.453141:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+23:11860:x1876044696095744:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789135998.453926:0:5854:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789135998.454030:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789135998.454077:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454096:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454108:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454117:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454133:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454140:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.454154:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135998.454413:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135998.454420:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.454426:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789135998.454430:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.454438:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.454450:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ba05c1c2f00) 00010000:00010000:0.0:1789135998.454453:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135998.454458:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.454464:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937a00/0x38eb79866bf96f99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135998.454480:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135998.454482:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135998.454483:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135998.456797:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11860:x1876044696095744:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 3647us (4139us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789135998.456813:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 61 00000020:00080000:2.0:1789135998.456820:0:5854:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135998.466035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.466112:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696095872 00000100:00100000:3.0:1789135998.466405:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696095872 00000100:00100000:3.0:1789135998.466612:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:3.0:1789135998.466623:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058271450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11859:x1876044696095872:12345-192.168.204.41@tcp:49:lfs.0 00000100:00100000:3.0:1789135998.467067:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058271450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11859:x1876044696095872:12345-192.168.204.41@tcp:49:lfs.0 Request processed in 446us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.467076:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 62 00000100:00100000:0.0:1789135998.475347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.475439:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096128 00000100:00100000:3.0:1789135998.475448:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096128 00000100:00100000:3.0:1789135998.475508:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 231 00000100:00100000:3.0:1789135998.475519:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11859:x1876044696096128:12345-192.168.204.41@tcp:58:lfs.0 00000040:00080000:3.0:1789135998.475860:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789135998.475942:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11859:x1876044696096128:12345-192.168.204.41@tcp:58:lfs.0 Request processed in 424us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.475950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 231 00000100:00100000:1.0:1789135998.557759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789135998.557952:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096256 00000100:00100000:2.0:1789135998.557963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096256 00000100:00100000:2.0:1789135998.558033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 232 00000100:00100000:2.0:1789135998.558043:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+25:11862:x1876044696096256:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789135998.558064:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135998.558086:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558144:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558158:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558169:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558184:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558204:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558210:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558475:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558485:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558493:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558841:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.558858:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 26 pid: 5851 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135998.558873:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723345408:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789135998.559022:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0512e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135998.573678:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1876044723345408:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789135998.573762:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135998.574623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135998.575021:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096512 00000100:00100000:0.0:1789135998.575029:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096512 00000100:00100000:0.0:1789135998.575081:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:0.0:1789135998.575102:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:5607:x1876044696096512:12345-192.168.204.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789135998.575335:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:5607:x1876044696096512:12345-192.168.204.41@tcp:35:ldlm_bl.0 Request processed in 234us (714us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789135998.575344:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 63 00000100:00100000:0.0:1789135998.583100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135998.583220:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096640 00000100:00100000:3.0:1789135998.583229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096640 00010000:00010000:3.0:1789135998.583271:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 28 pid: 5851 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135998.583308:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 90 00000100:00100000:3.0:1789135998.583316:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:2363:x1876044696096640:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135998.583331:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135998.583338:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 28 pid: 5851 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583350:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 28 pid: 5851 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583388:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cc800/0x38eb79866bf96ec0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630299 expref: 28 pid: 5851 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583403:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135998.583407:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583417:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583424:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135998.583458:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135998.583526:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:2363:x1876044696096640:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 210us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.583534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 90 00010000:00010000:2.0:1789135998.583757:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583772:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135998.583893:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789135998.583898:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135998.583918:0:5851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583931:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583940:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583946:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583953:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583958:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135998.583962:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583968:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.583977:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:2.0:1789135998.583980:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135998.583984:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584000:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf96fa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584012:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584018:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584023:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584027:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135998.584030:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584036:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584044:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ba05c1c2500) 00010000:00010000:2.0:1789135998.584047:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135998.584049:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584054:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584086:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936c00/0x38eb79866bf96fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d8 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584098:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d8 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135998.584112:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135998.584114:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135998.584117:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936e00, rc 0) 00000100:00100000:2.0:1789135998.584145:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11862:x1876044696096256:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 26104us (26395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135998.584152:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 232 00010000:00010000:3.0:1789135998.801429:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135998.836006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.836069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.836103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135998.836138:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696097024 00000100:00100000:1.0:1789135998.836150:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696097024 00000100:00100000:1.0:1789135998.836221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 189 00000100:00100000:1.0:1789135998.836240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696097024:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789135998.836340:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2364:x1876044696097024:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135998.836349:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 189 00000100:00080000:1.0:1789135998.836374:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135998.836766:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096768 00000100:00100000:3.0:1789135998.836771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096768 00000100:00100000:3.0:1789135998.836803:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 336 00000100:00100000:3.0:1789135998.836811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696096768:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135998.836844:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696096768:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 34us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.836849:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 336 00000100:00100000:3.0:1789135998.836892:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696096896 00000100:00100000:3.0:1789135998.836895:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696096896 00000100:00100000:3.0:1789135998.836935:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:3.0:1789135998.836941:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696096896:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789135998.836967:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696096896:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135998.836973:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00080000:3.0:1789135998.836987:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135999.181129:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723345536:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.181208:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135999.181375:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135999.181382:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723345920:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.181424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135999.181463:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345920 00000100:00100000:3.0:1789135999.181469:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345920 00000100:00100000:3.0:1789135999.181520:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789135999.181529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723345920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.181584:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723345920:12345-0@lo:400:kworker.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.181592:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789135999.181648:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723345920:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.181952:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723345664:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.182037:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723346048:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.182131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135999.182158:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723346176:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.182181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135999.182184:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345664 00000100:00100000:3.0:1789135999.182189:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345664 00000100:00100000:1.0:1789135999.182199:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135999.182205:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723345792:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.182216:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789135999.182223:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.182257:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723345664:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.182279:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789135999.182297:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346176 00000100:00100000:3.0:1789135999.182300:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346176 00000100:00100000:3.0:1789135999.182321:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789135999.182328:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723346176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.182360:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723346176:12345-0@lo:400:kworker.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.182366:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789135999.182389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135999.182503:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346048 00000100:00100000:3.0:1789135999.182507:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346048 00000100:00100000:3.0:1789135999.182536:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789135999.182542:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723346048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.182576:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723346048:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.182582:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1789135999.182600:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135999.182623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723346048:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.183657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135999.183932:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723345664:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.183945:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723346176:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.184045:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345792 00000100:00100000:3.0:1789135999.184051:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345792 00000100:00100000:3.0:1789135999.184222:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789135999.184229:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723345792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.184274:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723345792:12345-0@lo:400:kworker.0 Request processed in 45us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.184279:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1789135999.184317:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135999.184335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723345792:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.185651:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723345536 00000100:00100000:0.0:1789135999.185662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723345536 00000100:00100000:1.0:1789135999.185809:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135999.185833:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723346304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135999.185887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135999.186286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789135999.186310:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.186321:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346304 00000100:00100000:0.0:1789135999.186327:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346304 00000100:00100000:0.0:1789135999.186372:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789135999.186381:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723346304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135999.186414:0:6701:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135999.186466:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876044723346304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135999.186473:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135999.186517:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723346304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135999.191352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3314:x1876044723345536:12345-0@lo:400:kworker.0 Request processed in 5037us (10133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.191368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789135999.191617:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723345536:0@lo:400:kworker.0 00000040:00080000:2.0:1789135999.500918:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135999.500938:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135999.500977:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789135999.500984:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135999.501114:0:12107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723346432:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135999.501211:0:12107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135999.508786:0:12107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12107:1876044723346432:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135999.508786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135999.508851:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696097152 00000100:00100000:3.0:1789135999.508860:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696097152 00000100:00100000:3.0:1789135999.509932:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 233 00000100:00100000:3.0:1789135999.509944:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11873:x1876044696097152:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135999.509982:0:5850:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135999.510087:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11873:x1876044696097152:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 145us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.510096:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 233 00000100:00080000:1.0:1789135999.516330:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135999.518230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135999.518440:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696097408 00000100:00100000:3.0:1789135999.518450:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696097408 00000100:00100000:3.0:1789135999.518606:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 234 00000100:00100000:3.0:1789135999.518619:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+26:11873:x1876044696097408:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135999.518642:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135999.518666:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96fbc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302df expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.518822:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.518839:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.518855:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135999.518874:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789135999.519008:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5c00/0x38eb79866bf96fbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302df expref: 29 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.519025:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302df expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.519033:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135999.519036:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135999.519039:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789135999.519101:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11873:x1876044696097408:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 486us (878us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789135999.519109:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 234 00000100:00100000:3.0:1789135999.532444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135999.532485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135999.532515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696097792 00000100:00100000:3.0:1789135999.532524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696097792 00000100:00100000:3.0:1789135999.532583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:3.0:1789135999.532593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:2365:x1876044696097792:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135999.532611:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135999.532636:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302df expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.532668:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135999.532673:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135999.532755:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:2365:x1876044696097792:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 163us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.532772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:2.0:1789135999.534265:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696097664 00000100:00100000:2.0:1789135999.534276:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696097664 00000100:00100000:2.0:1789135999.534348:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 235 00000100:00100000:2.0:1789135999.534358:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+27:11873:x1876044696097664:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789135999.534438:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534456:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534467:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534674:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534682:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534690:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534724:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789135999.534728:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534736:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534749:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:2.0:1789135999.534752:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135999.534757:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135999.534763:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf96fd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135999.534907:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11873:x1876044696097664:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 550us (2473us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789135999.534917:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 235 00000040:00080000:3.0:1789135999.535020:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135999.535025:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135999.535520:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789135999.535528:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135999.549126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789135999.549489:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098048 00000100:00100000:0.0:1789135999.549501:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098048 00000100:00100000:0.0:1789135999.549574:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 64 00000100:00100000:0.0:1789135999.549585:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+28:11873:x1876044696098048:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789135999.549884:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:11873:x1876044696098048:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 298us (768us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789135999.549893:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 64 00000040:00080000:1.0:1789135999.569442:0:13037:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135999.569461:0:13037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135999.569509:0:13037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789135999.569515:0:13037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135999.695488:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135999.697188:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723346560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135999.697265:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135999.703382:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346560 00000100:00100000:2.0:1789135999.703397:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346560 00000100:00100000:2.0:1789135999.703465:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789135999.703488:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723346560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135999.703516:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789135999.703599:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723346560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (6334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135999.703606:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135999.703900:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723346560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135999.830106:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135999.876990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789135999.877179:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098304 00000100:00100000:1.0:1789135999.877190:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098304 00000100:00100000:1.0:1789135999.877249:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 236 00000100:00100000:1.0:1789135999.877258:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+29:11886:x1876044696098304:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789135999.877281:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135999.877302:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135999.877405:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96fdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135999.877421:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96fdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135999.877433:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96fdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135999.877444:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789135999.877594:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf96fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302e6 expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135999.877611:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96fdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302e6 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135999.877632:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:1.0:1789135999.877635:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789135999.877639:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7e00, rc 0) 00000100:00100000:1.0:1789135999.877916:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11886:x1876044696098304:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 658us (936us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789135999.878002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 236 00000100:00100000:1.0:1789135999.884412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789135999.884502:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098432 00000100:00100000:3.0:1789135999.884628:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098432 00000100:00100000:3.0:1789135999.884696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 237 00000100:00100000:3.0:1789135999.884733:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11886:x1876044696098432:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:3.0:1789135999.884805:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884824:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884835:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884860:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884866:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884872:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884878:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789135999.884881:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884896:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884908:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:3.0:1789135999.884911:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135999.884917:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135999.884923:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4a00/0x38eb79866bf96fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135999.885162:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+31:11886:x1876044696098432:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 432us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135999.885170:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 237 00000100:00100000:2.0:1789136000.041266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136000.043487:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098560 00000100:00100000:3.0:1789136000.043505:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098560 00000100:00100000:3.0:1789136000.043608:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00100000:3.0:1789136000.043621:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2366:x1876044696098560:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:3.0:1789136000.043639:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136000.043660:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf96ff4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302ed expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136000.043737:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa40c7c, atime: 0x6aa40c7b, ctime: 0x6aa40c7c, blocks: 0xb 00010000:00010000:3.0:1789136000.043759:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1789136000.043764:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136000.043774:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf96ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ed expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136000.043813:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf96ff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ed expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136000.043826:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4a00, rc 0) 00000100:00100000:3.0:1789136000.043904:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2366:x1876044696098560:12345-192.168.204.41@tcp:101:cat.0 Request processed in 288us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136000.043918:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 73 00000100:00080000:1.0:1789136000.044326:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136000.074229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136000.074328:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098688 00000100:00100000:1.0:1789136000.074339:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098688 00002000:00100000:1.0:1789136000.074395:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ba085f7c3c0 x1876044696098688/t0(0) o3->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:431/0 lens 488/0 e 0 to 0 dl 1789136011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789136000.074406:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f7c3c0 with x1876044696098688 ext(0->4095) 00002000:00010000:1.0:1789136000.074412:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f7c3c0 00000100:00100000:1.0:1789136000.074448:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:1.0:1789136000.074458:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696098688:12345-192.168.204.41@tcp:3:cat.0 00000100:00100000:1.0:1789136000.074755:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+8:2363:x1876044696098688:12345-192.168.204.41@tcp:3:cat.0 Request processed in 297us (538us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789136000.074762:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00002000:00100000:1.0:1789136000.074769:0:6703:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ba085f7c3c0 x1876044696098688/t0(0) o3->ffb60b9b-a844-43c7-b566-1c6255980b3c@192.168.204.41@tcp:431/0 lens 488/4536 e 0 to 0 dl 1789136011 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789136000.074777:0:6703:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8ba085f7c3c0 with x1876044696098688 ext(0->4095) 00002000:00010000:1.0:1789136000.074781:0:6703:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ba085f7c3c0 00000001:00080000:0.0:1789136000.807891:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1789136000.807913:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1789136000.844960:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136001.870953:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136002.893689:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789136003.451947:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1789136003.451973:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b9f46e67e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789136003.451978:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba044bce400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b9f46e67780 00000020:00080000:0.0:1789136003.451981:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ba044bce100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ba074183000 00000020:00080000:3.0:1789136003.452015:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1789136003.452238:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789136003.452282:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789136003.452290:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:2.0:1789136003.895335:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1789136003.895353:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1789136003.895359:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1789136003.917841:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136003.955618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136003.955680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136003.955732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136003.955762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136003.955769:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099072 00000100:00100000:3.0:1789136003.955781:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099072 00000100:00100000:1.0:1789136003.955792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136003.955822:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099328 00000100:00100000:1.0:1789136003.955827:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099328 00000100:00100000:3.0:1789136003.955853:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099200 00000100:00100000:3.0:1789136003.955858:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099200 00000100:00100000:1.0:1789136003.955870:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098944 00000100:00100000:1.0:1789136003.955875:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098944 00000100:00100000:3.0:1789136003.955898:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:1.0:1789136003.955910:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 193 00000100:00100000:3.0:1789136003.955912:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2365:x1876044696099072:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136003.955923:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696099328:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136003.956005:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2365:x1876044696099072:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136003.956013:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:3.0:1789136003.956034:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:3.0:1789136003.956042:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696099200:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136003.956112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696098816 00000100:00100000:0.0:1789136003.956117:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696098816 00000100:00100000:0.0:1789136003.956144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 338 00000100:00100000:0.0:1789136003.956152:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696098816:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136003.959451:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2365:x1876044696099328:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 3516us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136003.959465:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 193 00000100:00100000:1.0:1789136003.959504:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00100000:1.0:1789136003.959518:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2365:x1876044696098944:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136003.959595:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2365:x1876044696098944:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 83us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136003.959601:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 194 00000100:00080000:1.0:1789136003.959647:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136003.959653:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136003.959655:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136003.964605:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2365:x1876044696099200:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 8549us (8798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136003.964653:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 85 00000100:00100000:0.0:1789136003.966507:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2365:x1876044696098816:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 10344us (10899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136003.966520:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 338 00000100:00100000:1.0:1789136004.301112:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723346688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136004.301195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136004.301329:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346688 00000100:00100000:3.0:1789136004.301337:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346688 00000100:00100000:3.0:1789136004.301417:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789136004.301429:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723346688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136004.301482:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136004.301536:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723346688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136004.301545:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789136004.301660:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136004.301689:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789136004.301695:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789136004.301746:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba072f1cf00, transno 4294967310 00000100:00100000:1.0:1789136004.301783:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723346688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136004.302542:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723346944:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.302591:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.302629:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789136004.302635:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723346816:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.302663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.302695:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723347328:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.302749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.302778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346816 00000100:00100000:2.0:1789136004.302783:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346816 00000100:00100000:2.0:1789136004.302815:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789136004.302822:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723346816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.302861:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3312:x1876044723346816:12345-0@lo:400:kworker.0 Request processed in 39us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.302868:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789136004.302902:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723346944 00000100:00100000:2.0:1789136004.302914:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723346944 00000100:00100000:2.0:1789136004.302940:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347328 00000100:00100000:2.0:1789136004.302943:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347328 00000100:00100000:2.0:1789136004.302970:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789136004.302977:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723346944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.303010:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723346944:12345-0@lo:400:kworker.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.303017:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789136004.303031:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789136004.303037:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723347328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.303063:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723347328:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.303069:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1789136004.303095:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136004.303119:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723346816:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.303132:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723347328:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.303140:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723346944:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.303228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723347072:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.303261:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136004.303288:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136004.303296:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723347200:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.303323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136004.303397:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347072 00000100:00100000:0.0:1789136004.303403:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347072 00000100:00100000:0.0:1789136004.303447:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789136004.303454:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723347072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789136004.303551:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136004.303624:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723347072:12345-0@lo:400:kworker.0 Request processed in 170us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.303631:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789136004.303745:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723347072:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.304015:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347200 00000100:00100000:2.0:1789136004.304020:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347200 00000100:00100000:2.0:1789136004.304066:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789136004.304074:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723347200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.304119:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723347200:12345-0@lo:400:kworker.0 Request processed in 46us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.304126:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789136004.304164:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789136004.304172:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba072d143c0, transno 4294967322 00000004:00080000:2.0:1789136004.304198:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789136004.304218:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723347200:0@lo:400:kworker.0 00000100:00080000:3.0:1789136004.304694:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136004.813373:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136004.813398:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723347456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136004.813470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136004.813942:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347456 00000100:00100000:3.0:1789136004.813952:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347456 00000100:00100000:3.0:1789136004.814014:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789136004.814025:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723347456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136004.814060:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136004.814127:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723347456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136004.814135:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789136004.815788:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723347456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789136004.941894:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136005.964939:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136006.005567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136006.005770:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099456 00000100:00100000:2.0:1789136006.005785:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099456 00000100:00100000:2.0:1789136006.005867:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 238 00000100:00100000:2.0:1789136006.005880:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11539:x1876044696099456:12345-192.168.204.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789136006.005994:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11539:x1876044696099456:12345-192.168.204.41@tcp:60:lhsmtool_posix.0 Request processed in 117us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136006.006002:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 238 00000100:00080000:3.0:1789136006.008333:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136006.016121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136006.016277:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099712 00000100:00100000:0.0:1789136006.016303:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099712 00000100:00100000:0.0:1789136006.016392:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:0.0:1789136006.016402:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:11539:x1876044696099712:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789136006.018641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:11539:x1876044696099712:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 2228us (2518us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789136006.018656:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 65 00000100:00100000:1.0:1789136006.421239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136006.421353:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099840 00000100:00100000:2.0:1789136006.421362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099840 00000100:00100000:2.0:1789136006.421443:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 239 00000100:00100000:2.0:1789136006.421452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:12339:x1876044696099840:12345-192.168.204.41@tcp:101:lsof.0 00010000:00010000:2.0:1789136006.421472:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136006.421495:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96ffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6302f4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.421560:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.421585:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.421599:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136006.421850:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789136006.421861:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789136006.421953:0:5852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.421982:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937600/0x38eb79866bf96ffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302f4 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.421998:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302f4 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136006.422006:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789136006.422009:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136006.422012:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937400, rc 0) 00000100:00100000:2.0:1789136006.422084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:12339:x1876044696099840:12345-192.168.204.41@tcp:101:lsof.0 Request processed in 633us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136006.422093:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 239 00000100:00080000:3.0:1789136006.422859:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789136006.989293:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136007.757020:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789136007.757030:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136007.757334:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789136007.757341:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789136008.013502:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789136008.462095:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789136008.462120:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789136008.462137:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789136008.462154:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789136009.038867:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136009.073264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136009.073313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136009.073347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136009.073383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136009.073416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136009.073446:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100352 00000100:00100000:3.0:1789136009.073456:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100352 00000100:00100000:3.0:1789136009.073533:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100224 00000100:00100000:3.0:1789136009.073536:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100224 00000100:00100000:3.0:1789136009.073561:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:3.0:1789136009.073570:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696100352:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136009.073650:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696100352:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 81us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.073658:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:3.0:1789136009.073675:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:3.0:1789136009.073682:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696100224:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136009.073743:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2364:x1876044696100224:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 61us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.073767:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00080000:3.0:1789136009.073785:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789136009.073789:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136009.074106:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100096 00000100:00100000:1.0:1789136009.074112:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100096 00000100:00100000:1.0:1789136009.074157:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100480 00000100:00100000:1.0:1789136009.074160:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100480 00000100:00100000:1.0:1789136009.074183:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 198 00000100:00100000:1.0:1789136009.074189:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696100096:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136009.074229:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696100096:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 41us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136009.074235:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 198 00000100:00100000:1.0:1789136009.074248:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 199 00000100:00100000:1.0:1789136009.074253:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696100480:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136009.074273:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696100480:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 21us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136009.074279:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 199 00000100:00100000:0.0:1789136009.074805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696099968 00000100:00100000:0.0:1789136009.074811:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696099968 00000100:00100000:0.0:1789136009.074866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 340 00000100:00100000:0.0:1789136009.074884:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696099968:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136009.074923:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696099968:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 41us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136009.074929:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 340 00000100:00080000:3.0:1789136009.075932:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136009.422833:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723347712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136009.422835:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723347840:0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.422928:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723347584:0@lo:400:kworker.0 00000100:00100000:2.0:1789136009.423585:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723347968:0@lo:400:kworker.0 00000100:00100000:0.0:1789136009.425535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136009.425635:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723348352:0@lo:400:kworker.0 00000100:00100000:0.0:1789136009.425678:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136009.425762:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347840 00000100:00100000:0.0:1789136009.425772:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347840 00000100:00100000:0.0:1789136009.425833:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789136009.425844:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723347840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136009.425913:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723347840:12345-0@lo:400:kworker.0 Request processed in 71us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136009.425921:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789136009.426102:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723347840:0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.426383:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348352 00000100:00100000:3.0:1789136009.426389:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348352 00000100:00100000:3.0:1789136009.426619:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789136009.426629:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723348352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.426687:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723348352:12345-0@lo:400:kworker.0 Request processed in 60us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.426694:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1789136009.426732:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136009.426760:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723348352:0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.426810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136009.426837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723348224:0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.426866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136009.426896:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347712 00000100:00100000:3.0:1789136009.426901:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347712 00000100:00100000:3.0:1789136009.426930:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789136009.426937:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723347712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136009.426974:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136009.427014:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723347712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.427020:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789136009.427039:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348224 00000100:00100000:3.0:1789136009.427053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348224 00000100:00100000:3.0:1789136009.427086:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789136009.427092:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723348224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.427121:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723348224:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.427127:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1789136009.427144:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136009.427170:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723347712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136009.428865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136009.428945:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723348096:0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.428985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136009.429049:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347584 00000100:00100000:1.0:1789136009.429058:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347584 00000100:00100000:1.0:1789136009.429111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789136009.429121:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723347584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.429175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723347584:12345-0@lo:400:kworker.0 Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136009.429183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789136009.429221:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348096 00000100:00100000:1.0:1789136009.429225:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348096 00000100:00100000:1.0:1789136009.429265:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789136009.429271:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.429303:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723348096:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136009.429309:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789136009.429352:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723347584:0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.429366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723348096:0@lo:400:kworker.0 00000100:00100000:3.0:1789136009.429389:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723348224:0@lo:400:kworker.0 00000100:00080000:3.0:1789136009.429558:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136009.432839:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136009.433022:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723347968 00000100:00100000:0.0:1789136009.433045:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723347968 00000100:00100000:0.0:1789136009.433141:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789136009.433153:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723347968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789136009.433227:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136009.433235:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723347968:12345-0@lo:400:kworker.0 Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136009.433244:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789136009.433301:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723347968:0@lo:400:kworker.0 00000100:00100000:1.0:1789136009.932985:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136009.933022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723348480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136009.933135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136009.933267:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348480 00000100:00100000:3.0:1789136009.933278:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348480 00000100:00100000:3.0:1789136009.933353:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789136009.933365:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723348480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136009.933416:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136009.933480:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723348480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136009.933489:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789136009.933563:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723348480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789136010.069456:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789136010.222693:0:13237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:13:27 (1789136007) 00010000:00010000:0.0:1789136011.085182:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136012.109167:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136013.132995:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136014.157286:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136014.196941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136014.196991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136014.197031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136014.197061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136014.197083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136014.197249:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100864 00000100:00100000:3.0:1789136014.197261:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100864 00000100:00100000:3.0:1789136014.197327:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100992 00000100:00100000:3.0:1789136014.197331:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100992 00000100:00100000:3.0:1789136014.197356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:3.0:1789136014.197366:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696100864:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136014.197469:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2363:x1876044696100864:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 105us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.197478:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:3.0:1789136014.197496:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:3.0:1789136014.197502:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696100992:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136014.197526:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2363:x1876044696100992:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.197533:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:3.0:1789136014.197564:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696101120 00000100:00100000:3.0:1789136014.197567:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696101120 00000100:00100000:3.0:1789136014.197595:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100736 00000100:00100000:3.0:1789136014.197598:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100736 00000100:00100000:3.0:1789136014.197614:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 203 00000100:00100000:3.0:1789136014.197620:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696101120:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136014.197649:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2363:x1876044696101120:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.197655:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 203 00000100:00100000:3.0:1789136014.197672:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00100000:3.0:1789136014.197679:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696100736:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136014.197735:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:2363:x1876044696100736:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 56us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.197742:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 204 00000100:00080000:0.0:1789136014.198544:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136014.198551:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136014.198553:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136014.198787:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696100608 00000100:00100000:1.0:1789136014.198793:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696100608 00000100:00100000:1.0:1789136014.198842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 342 00000100:00100000:1.0:1789136014.198853:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696100608:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136014.198914:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2363:x1876044696100608:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 66us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136014.198921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 342 00000100:00100000:1.0:1789136014.541310:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723348608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136014.541406:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136014.542823:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723349120:0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.542880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136014.542921:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136014.542927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723348736:0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.542957:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136014.543007:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723348992:0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.543035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136014.543052:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136014.543057:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723348864:0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.543099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136014.543141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348736 00000100:00100000:2.0:1789136014.543148:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348736 00000100:00100000:2.0:1789136014.543198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789136014.543208:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723348736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.543263:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723348736:12345-0@lo:400:kworker.0 Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136014.543272:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789136014.543320:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723348736:0@lo:400:kworker.0 00000100:00100000:0.0:1789136014.543546:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723349248:0@lo:400:kworker.0 00000100:00100000:0.0:1789136014.543575:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136014.543800:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348608 00000100:00100000:3.0:1789136014.543806:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348608 00000100:00100000:3.0:1789136014.543857:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789136014.543871:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723348608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136014.543905:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136014.543945:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723348608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.543952:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789136014.543978:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348992 00000100:00100000:3.0:1789136014.543981:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348992 00000100:00100000:3.0:1789136014.544010:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723348864 00000100:00100000:3.0:1789136014.544013:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723348864 00000100:00100000:3.0:1789136014.544025:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349248 00000100:00100000:3.0:1789136014.544027:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349248 00000100:00100000:3.0:1789136014.544043:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789136014.544050:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544091:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723348992:12345-0@lo:400:kworker.0 Request processed in 41us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.544098:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789136014.544111:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789136014.544117:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544145:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723348864:12345-0@lo:400:kworker.0 Request processed in 29us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.544151:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789136014.544163:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789136014.544168:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723349248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544206:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723349248:12345-0@lo:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.544212:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789136014.544246:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723349248:0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544282:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723348864:0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544292:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723348992:0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544313:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349120 00000100:00100000:3.0:1789136014.544316:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349120 00000100:00100000:3.0:1789136014.544340:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789136014.544346:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723349120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136014.544373:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723349120:12345-0@lo:400:kworker.0 Request processed in 27us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.544379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789136014.544885:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723349120:0@lo:400:kworker.0 00000100:00100000:2.0:1789136014.544906:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723348608:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789136014.544981:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789136014.544987:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136014.544989:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136014.709069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136014.710070:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696101376 00000100:00100000:1.0:1789136014.710083:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696101376 00000100:00100000:1.0:1789136014.710167:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:1.0:1789136014.710179:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+18:12560:x1876044696101376:12345-192.168.204.41@tcp:35:umount.0 00000100:00100000:1.0:1789136014.710848:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:12560:x1876044696101376:12345-192.168.204.41@tcp:35:umount.0 Request processed in 666us (1785us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789136014.710858:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 66 00000100:00100000:3.0:1789136014.714628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136014.720880:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696101632 00000100:00100000:1.0:1789136014.720993:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696101632 00000100:00100000:1.0:1789136014.721135:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:1.0:1789136014.721148:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+19:12560:x1876044696101632:12345-192.168.204.41@tcp:35:umount.0 00000100:00100000:1.0:1789136014.721579:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:12560:x1876044696101632:12345-192.168.204.41@tcp:35:umount.0 Request processed in 433us (6961us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789136014.721587:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 67 00000100:00100000:0.0:1789136014.725009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136014.725186:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696101888 00000100:00100000:3.0:1789136014.725197:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696101888 00000100:00100000:3.0:1789136014.725261:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:3.0:1789136014.725271:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058270450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+20:12560:x1876044696101888:12345-192.168.204.41@tcp:35:umount.0 00000100:00100000:3.0:1789136014.726631:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058270450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:12560:x1876044696101888:12345-192.168.204.41@tcp:35:umount.0 Request processed in 1354us (1624us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789136014.726644:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 68 00000100:00100000:0.0:1789136014.731661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136014.732046:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696102144 00000100:00100000:1.0:1789136014.732056:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696102144 00000100:00100000:0.0:1789136014.733933:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:0.0:1789136014.733947:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+21:12560:x1876044696102144:12345-192.168.204.41@tcp:35:umount.0 00000100:00100000:0.0:1789136014.734624:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:12560:x1876044696102144:12345-192.168.204.41@tcp:35:umount.0 Request processed in 678us (2971us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789136014.734634:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 69 00000100:00100000:2.0:1789136014.743960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136014.744006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136014.744034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136014.744062:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696102272 00000100:00100000:2.0:1789136014.744072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696102272 00000100:00100000:2.0:1789136014.744143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696102528 00000100:00100000:2.0:1789136014.744155:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696102528 00000100:00100000:2.0:1789136014.744174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696102400 00000100:00100000:2.0:1789136014.744176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696102400 00000100:00100000:1.0:1789136014.744181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789136014.744191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:1.0:1789136014.744193:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+15:2364:x1876044696102272:12345-192.168.204.41@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789136014.744196:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+15:2364:x1876044696102528:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136014.744208:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136014.744208:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136014.744229:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cc600/0x38eb79866bf9625d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff4a expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136014.744230:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a4800/0x38eb79866bf96034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe71 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136014.744246:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136014.744249:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136014.744295:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1c2678a-1780-480c-8bd9-51a1945fdd3f+13:2364:x1876044696102272:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136014.744302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:3.0:1789136014.744322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:3.0:1789136014.744330:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696102400:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136014.744338:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136014.744347:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cca00/0x38eb79866bf95f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe39 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136014.744355:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136014.746975:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059227450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:2364:x1876044696102528:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 2763us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136014.746990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:3.0:1789136014.748077:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696102400:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 3740us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.748096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:0.0:1789136014.748522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136014.748592:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696102656 00000100:00100000:3.0:1789136014.748602:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696102656 00000100:00100000:3.0:1789136014.748655:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:3.0:1789136014.748664:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696102656:12345-192.168.204.41@tcp:9:umount.0 00000020:00000080:3.0:1789136014.748694:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf969f7 00000100:00080000:3.0:1789136014.748735:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f4621e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136014.748782:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1789136014.749005:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136014.749450:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffb60b9b-a844-43c7-b566-1c6255980b3c+2:2362:x1876044696102656:12345-192.168.204.41@tcp:9:umount.0 Request processed in 784us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.749458:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 74 00000100:00100000:2.0:1789136014.756219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136014.756521:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696103040 00000100:00100000:3.0:1789136014.756538:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696103040 00000100:00100000:3.0:1789136014.756600:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:3.0:1789136014.756610:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2362:x1876044696103040:12345-192.168.204.41@tcp:9:umount.0 00000020:00000080:3.0:1789136014.756641:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf965b3 00000020:00010000:3.0:1789136014.756649:0:6698:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ba085f42800: total 0 00000100:00080000:3.0:1789136014.756654:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b9f478e5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136014.756730:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789136014.757013:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffb60b9b-a844-43c7-b566-1c6255980b3c+5:2362:x1876044696103040:12345-192.168.204.41@tcp:9:umount.0 Request processed in 403us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136014.757022:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 75 00000020:00010000:1.0:1789136014.757528:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ba085f42800: total 0 00010000:00010000:1.0:1789136014.757570:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ba085f42800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789136014.757625:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf96ff4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302ed expref: 4 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136014.757659:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf9694f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63011f expref: 3 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136014.757675:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ba085f42800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789136014.757687:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136014.757689:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136014.757692:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136014.775107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136014.775340:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104064 00000100:00100000:3.0:1789136014.775350:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104064 00000100:00100000:3.0:1789136014.775416:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 240 00000100:00100000:3.0:1789136014.775427:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+22:2362:x1876044696104064:12345-192.168.204.41@tcp:39:umount.0 00000020:00000080:3.0:1789136014.775472:0:8031:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95fa8 00000020:00010000:3.0:1789136014.775489:0:8031:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b9f463a2000: total 0 00000100:00080000:3.0:1789136014.775494:0:8031:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ed000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789136014.775659:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b9f463a2000: total 0 00010000:00010000:0.0:1789136014.775664:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136014.775741:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b9f463a2000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789136014.775776:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789136014.775780:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789136014.775789:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937800/0x38eb79866bf9660e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630046 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775812:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:0.0:1789136014.775815:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136014.775819:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf962b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff58 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775838:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789136014.775840:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789136014.775844:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030600/0x38eb79866bf9693a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630118 expref: 19 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789136014.775858:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789136014.775869:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0862cd800/0x38eb79866bf96cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630214 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775885:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789136014.775887:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789136014.775891:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7e00/0x38eb79866bf96fdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302e6 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775901:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ba05c1e9200) 00010000:00010000:0.0:1789136014.775903:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789136014.775916:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4000/0x38eb79866bf969cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630142 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775932:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789136014.775934:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136014.775938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4200/0x38eb79866bf96830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6300d2 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775949:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ba05c1e9100) 00010000:00010000:0.0:1789136014.775951:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789136014.775955:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf96321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff74 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775968:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789136014.775970:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136014.775973:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf96ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302a0 expref: 13 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.775986:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba05c1e9500) 00010000:00010000:0.0:1789136014.775994:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136014.775999:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a4e00/0x38eb79866bf962cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff5f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.776016:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ba05c659800) 00010000:00010000:0.0:1789136014.776018:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136014.776022:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf96fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302d8 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.776037:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:0.0:1789136014.776039:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136014.776043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba040030400/0x38eb79866bf969b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63013b expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.776053:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789136014.776055:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136014.776059:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936600/0x38eb79866bf96910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63010a expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136014.776070:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b9f463a2000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789136014.776081:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136014.776083:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136014.776085:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789136014.776319:0:8031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789136014.776861:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffb60b9b-a844-43c7-b566-1c6255980b3c+7:2362:x1876044696104064:12345-192.168.204.41@tcp:39:umount.0 Request processed in 1433us (1762us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789136014.776871:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 240 00000100:00100000:0.0:1789136015.055026:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136015.055053:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723349376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136015.055141:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.055327:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349376 00000100:00100000:3.0:1789136015.055335:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349376 00000100:00100000:3.0:1789136015.055392:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789136015.055413:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723349376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136015.055449:0:6702:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136015.055505:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723349376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136015.055512:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789136015.055662:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723349376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136015.180933:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789136016.136339:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:2.0:1789136016.136347:0:7663:0:(genops.c:885:class_export_put()) final put ffff8b9f46218800/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:1.0:1789136016.136439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f46218800/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0001 00000020:00000080:1.0:1789136016.137882:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f4621e800 for lustre-OST0001 00010000:00010000:0.0:1789136016.206238:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136016.507505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136016.507555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136016.507635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136016.507980:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104320 00000100:00100000:3.0:1789136016.507992:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104320 00000100:00100000:3.0:1789136016.508059:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104192 00000100:00100000:3.0:1789136016.508062:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104192 00000100:00100000:3.0:1789136016.508075:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104448 00000100:00100000:3.0:1789136016.508077:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104448 00000100:00100000:3.0:1789136016.508094:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:3.0:1789136016.508103:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+12:2364:x1876044696104320:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136016.508119:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136016.508141:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9200/0x38eb79866bf96081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62feb0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136016.508158:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136016.508222:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+11:2364:x1876044696104320:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 120us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136016.508230:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:3.0:1789136016.508249:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:3.0:1789136016.508255:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+10:2364:x1876044696104192:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136016.508263:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136016.508273:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9400/0x38eb79866bf9607a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe86 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136016.508281:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136016.508298:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+9:2364:x1876044696104192:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 43us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136016.508304:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:3.0:1789136016.508315:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:3.0:1789136016.508321:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+8:2363:x1876044696104448:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136016.508327:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136016.508335:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a4600/0x38eb79866bf96256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62ff43 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136016.508343:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136016.508359:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1c2678a-1780-480c-8bd9-51a1945fdd3f+7:2363:x1876044696104448:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136016.508365:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:2.0:1789136016.530726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136016.530827:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104704 00000100:00100000:3.0:1789136016.530836:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104704 00000100:00100000:3.0:1789136016.530925:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 241 00000100:00100000:3.0:1789136016.530936:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+6:2362:x1876044696104704:12345-192.168.204.41@tcp:39:umount.0 00000020:00000080:3.0:1789136016.530989:0:5852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf9608f 00000020:00010000:3.0:1789136016.530998:0:5852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b9f46d45000: total 0 00000100:00080000:3.0:1789136016.531003:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d43000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136016.531035:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1789136016.531268:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:91a64b89-0f15-49f3-b3dc-09d2b2283f2e+5:2362:x1876044696104704:12345-192.168.204.41@tcp:39:umount.0 Request processed in 333us (578us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789136016.531277:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 241 00000100:00080000:0.0:1789136016.531604:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1789136016.531770:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b9f46d45000: total 0 00010000:00010000:2.0:1789136016.531814:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b9f46d45000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789136016.531848:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba06ca52400) 00010000:00010000:2.0:1789136016.531852:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136016.531861:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf97002 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6302f4 expref: 4 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136016.531884:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b9f46d45000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789136016.531896:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136016.531898:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136016.531900:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136016.571310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136016.571481:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696104960 00000100:00100000:2.0:1789136016.571492:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696104960 00000100:00100000:2.0:1789136016.571565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 344 00000100:00100000:2.0:1789136016.571575:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+7:2362:x1876044696104960:12345-192.168.204.41@tcp:251:umount.0 00000020:00000080:2.0:1789136016.571633:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f85 00000020:00010000:2.0:1789136016.571641:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b9f4724d800: total 0 00000100:00080000:2.0:1789136016.571646:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8b9f4724f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789136016.571749:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1c2678a-1780-480c-8bd9-51a1945fdd3f+3:2362:x1876044696104960:12345-192.168.204.41@tcp:251:umount.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136016.571757:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 344 00000020:00010000:0.0:1789136016.573558:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b9f4724d800: total 0 00010000:00010000:0.0:1789136016.573567:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136016.573619:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b9f4724d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789136016.573661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9603b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a62fe78 expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136016.573680:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b9f4724d800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789136016.573689:0:5838:0:(genops.c:885:class_export_put()) final put ffff8b9f4724d800/e1c2678a-1780-480c-8bd9-51a1945fdd3f 00010000:00010000:0.0:1789136016.573731:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136016.573734:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136016.573736:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789136016.573790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724d800/e1c2678a-1780-480c-8bd9-51a1945fdd3f for MGS 00000020:00000080:3.0:1789136016.573833:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f4724f000 for MGS 00010000:00010000:2.0:1789136017.230858:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136018.004326:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789136018.004334:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789136018.004780:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789136018.004788:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789136018.253027:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789136018.546008:0:13436:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789136018.565832:0:13436:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789136018.565887:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.565904:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.565910:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.565917:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.565938:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789136018.565942:0:13436:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789136018.565968:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136018.565973:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789136018.565978:0:13436:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789136018.566005:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8ba0736b9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789136018.566086:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723349504:0@lo:39:umount.0 00000100:00100000:3.0:1789136018.566157:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136018.566261:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349504 00000100:00100000:2.0:1789136018.566269:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349504 00010000:00010000:1.0:1789136018.567404:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136018.567413:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136018.567436:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031a00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789136018.567440:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136018.567450:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136018.567456:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136018.567462:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136018.567465:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789136018.567468:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789136018.567497:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136018.567504:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136018.567534:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136018.567541:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031a00/0x38eb79866bf9600a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96011 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136018.567553:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136018.567554:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136018.567556:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136018.567564:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136018.567577:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723349632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136018.567625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136018.567820:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789136018.567832:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876044723349504:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789136018.567859:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d94 00000100:00080000:2.0:1789136018.567867:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8ba043463800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789136018.567933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1876044723349504:12345-0@lo:39:umount.0 Request processed in 104us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136018.567939:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1789136018.567950:0:5850:0:(genops.c:885:class_export_put()) final put ffff8ba043462000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789136018.568069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136018.568209:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349632 00000100:00100000:3.0:1789136018.568216:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349632 00000100:00100000:3.0:1789136018.568294:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136018.568303:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3311:x1876044723349632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136018.568314:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136018.568329:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf96011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf9600a expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.568354:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136018.568470:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3311:x1876044723349632:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.568478:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789136018.568594:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723349632:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789136018.568643:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043462000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136018.569094:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba043463800 for lustre-MDT0000 00000100:00080000:3.0:1789136018.569126:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba0736b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136018.569182:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eeed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723349504:0@lo:39:umount.0 00000100:00080000:2.0:1789136018.569235:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136018.569239:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789136018.569243:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789136018.570468:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570483:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570490:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570498:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570523:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136018.570529:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570536:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570558:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570564:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570587:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136018.570595:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570601:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570607:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570613:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570621:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789136018.570625:0:13436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570630:0:13436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570636:0:13436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570651:0:13436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136018.570659:0:13436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789136018.570662:0:13436:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789136018.570690:0:13436:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789136018.570695:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789136018.570731:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136018.570737:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1789136018.570742:0:13436:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b9f45961800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136018.570748:0:13436:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b9f456a0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136018.570755:0:13436:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8b9f46d45000 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 192.168.204.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136018.570760:0:13436:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8b9f463a2000 ffb60b9b-a844-43c7-b566-1c6255980b3c 192.168.204.41@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1789136018.570766:0:13436:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ba074364ed8) has exports, disconnecting them 00000020:00080000:2.0:1789136018.570770:0:13436:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b9f45961800), last request at 1789136014 00000020:00000080:2.0:1789136018.570777:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f07 00000100:00080000:2.0:1789136018.570796:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8b9f45965000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789136018.570842:0:13436:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b9f45961800): rc 0 00000020:00000080:2.0:1789136018.570844:0:13436:0:(genops.c:885:class_export_put()) final put ffff8b9f45961800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789136018.570852:0:13436:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b9f456a0800), last request at 1789136014 00000020:00000080:2.0:1789136018.570856:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e3c 00000100:00080000:2.0:1789136018.570861:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8b9f456a6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789136018.570867:0:13436:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b9f456a0800): rc 0 00000020:00000080:2.0:1789136018.570869:0:13436:0:(genops.c:885:class_export_put()) final put ffff8b9f456a0800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789136018.570878:0:13436:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4230381bae0 00000100:00080000:2.0:1789136018.570898:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789136018.570906:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789136018.570917:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789136018.570972:0:13436:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789136018.570995:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8b9f47248800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789136018.571009:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789136018.571011:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789136018.571018:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789136018.571078:0:13436:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789136018.571085:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ee800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789136018.571111:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ba074364ed8) has no exports 00000020:00000080:3.0:1789136018.571264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f45961800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136018.571307:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f456a0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789136018.571331:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f45965000 for lustre-MDT0000 00000020:00000080:3.0:1789136018.571347:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f456a6000 for lustre-MDT0000 00010000:00010000:3.0:1789136018.571366:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789136018.571372:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571380:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136018.571384:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571392:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136018.571399:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136018.571404:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136018.571406:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789136018.571409:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789136018.571436:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571443:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136018.571474:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571481:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030e00/0x38eb79866bf96018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf9601f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571503:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136018.571507:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571512:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040030a00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136018.571515:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571522:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136018.571528:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136018.571532:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136018.571534:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789136018.571536:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789136018.571550:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571555:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136018.571562:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571568:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030a00/0x38eb79866bf95f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95f46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571579:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136018.571582:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571594:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8c00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136018.571598:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571605:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136018.571611:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136018.571615:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789136018.571618:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789136018.571619:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789136018.571633:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571639:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136018.571655:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571663:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8c00/0x38eb79866bf96280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96287 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571673:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136018.571676:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571682:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136018.571685:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571721:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136018.571729:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136018.571735:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136018.571737:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789136018.571739:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789136018.571755:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571761:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136018.571767:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571773:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8000/0x38eb79866bf95cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95cfa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.571784:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136018.571786:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136018.571788:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136018.571804:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723350016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.571870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.571922:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136018.571929:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723350144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.571953:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.571987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350016 00000100:00100000:3.0:1789136018.571994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350016 00000100:00100000:3.0:1789136018.572043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350144 00000100:00100000:3.0:1789136018.572047:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350144 00000100:00100000:3.0:1789136018.572071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136018.572078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+19:3313:x1876044723350016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136018.572090:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136018.572104:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf9601f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf96018 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.572115:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136018.572152:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+18:3313:x1876044723350016:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.572159:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136018.572175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136018.572181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba059227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3313:x1876044723350144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136018.572188:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136018.572196:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040030c00/0x38eb79866bf95f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95f3f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.572207:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136018.572227:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba059227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3313:x1876044723350144:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.572233:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136018.572283:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f48a59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723350400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.572306:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.572323:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136018.572328:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723350272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.572364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.572396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350400 00000100:00100000:3.0:1789136018.572399:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350400 00000100:00100000:3.0:1789136018.572422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350272 00000100:00100000:3.0:1789136018.572425:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350272 00000100:00100000:3.0:1789136018.572440:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136018.572446:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+17:3312:x1876044723350400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136018.572454:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136018.572463:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031600/0x38eb79866bf95cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95cf3 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.572476:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136018.572502:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a592c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+16:3312:x1876044723350400:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.572509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136018.572522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136018.572528:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+15:3312:x1876044723350272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136018.572534:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136018.572543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0862cdc00/0x38eb79866bf96287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf96280 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136018.572553:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136018.572576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3312:x1876044723350272:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.572582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136018.572619:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723350272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.572629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f48a59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3312:1876044723350400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.572651:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723349760:0@lo:9:umount.0 00000100:00100000:3.0:1789136018.572689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.572731:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723349888:0@lo:9:umount.0 00000100:00100000:3.0:1789136018.572752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136018.572782:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349760 00000100:00100000:3.0:1789136018.572786:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349760 00000100:00100000:3.0:1789136018.572815:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723349888 00000100:00100000:3.0:1789136018.572818:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723349888 00000100:00100000:3.0:1789136018.572838:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136018.572844:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876044723349760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136018.572864:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e89 00000100:00080000:3.0:1789136018.572871:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f47248000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136018.572899:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789136018.573060:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f48a59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1876044723349760:12345-0@lo:9:umount.0 Request processed in 215us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.573066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136018.573078:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789136018.573084:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876044723349888:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136018.573094:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f7e 00000100:00080000:3.0:1789136018.573099:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136018.573113:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789136018.573372:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1876044723349888:12345-0@lo:9:umount.0 Request processed in 287us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136018.573378:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789136018.573399:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136018.573402:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136018.573430:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723350144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136018.573439:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba07378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723350016:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789136018.573474:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f47248800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136018.573485:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136018.573487:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136018.573490:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eeda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723349760:0@lo:9:umount.0 00000100:00080000:3.0:1789136018.573499:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ee800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136018.573505:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136018.573507:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136018.573509:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723349888:0@lo:9:umount.0 00010000:00010000:3.0:1789136018.573538:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136018.573771:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789136018.583925:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ba074364ed8) has no exports 00000020:00000080:2.0:1789136018.622163:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d4e 00000020:00000080:2.0:1789136018.622181:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba059381800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789136018.622197:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789136018.622280:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136018.622292:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789136018.622296:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ba0592c8000) has no exports 00000020:00000080:3.0:1789136018.623530:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d47 00000020:00000080:3.0:1789136018.623540:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba0434f2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136018.623594:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136018.623602:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789136018.625655:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba059381800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789136018.625673:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba071cf2000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789136018.625675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba071cf2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789136018.625692:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789136018.625892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0434f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00080000:2.0:1789136018.665735:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789136018.665756:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000001:00080000:2.0:1789136018.665761:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789136018.665764:0:5873:0:(genops.c:885:class_export_put()) final put ffff8b9f46d45000/91a64b89-0f15-49f3-b3dc-09d2b2283f2e 00000001:00100000:2.0:1789136018.665778:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000001:00080000:2.0:1789136018.665784:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789136018.665788:0:5873:0:(genops.c:885:class_export_put()) final put ffff8b9f463a2000/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:1.0:1789136018.665840:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f46d45000/91a64b89-0f15-49f3-b3dc-09d2b2283f2e for lustre-MDT0000 00000020:00000080:1.0:1789136018.665916:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f463a2000/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-MDT0000 00000020:00000080:1.0:1789136018.665962:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f46d43000 for lustre-MDT0000 00000020:00000080:1.0:1789136018.665967:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba0491ed000 for lustre-MDT0000 00000001:00100000:3.0:1789136019.204203:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136019.204211:0:6724:0:(genops.c:885:class_export_put()) final put ffff8b9f4724e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789136019.204239:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:3.0:1789136019.204242:0:6724:0:(genops.c:885:class_export_put()) final put ffff8ba085f42800/ffb60b9b-a844-43c7-b566-1c6255980b3c 00000020:00000080:2.0:1789136019.204292:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789136019.204356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba085f42800/ffb60b9b-a844-43c7-b566-1c6255980b3c for lustre-OST0000 00000020:00000080:2.0:1789136019.204376:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f47248000 for lustre-OST0000 00000020:00000080:2.0:1789136019.204384:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f478e5800 for lustre-OST0000 00010000:00010000:3.0:1789136019.277007:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136019.661103:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136019.661171:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136019.661193:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723350656:0@lo:400:kworker.0 00000100:00100000:3.0:1789136019.662661:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136019.663291:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350656 00000100:00100000:2.0:1789136019.663303:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350656 00000100:00100000:2.0:1789136019.663370:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789136019.663382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876044723350656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789136019.663414:0:5852:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789136019.663484:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876044723350656:12345-0@lo:400:kworker.0 Request processed in 105us (824us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136019.663492:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1789136019.663532:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136019.663536:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b9f45963000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789136019.663540:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789136019.664530:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723350528:0@lo:400:kworker.0 00000100:00100000:1.0:1789136019.664590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136019.664801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350528 00000100:00100000:0.0:1789136019.664807:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350528 00000100:00100000:0.0:1789136019.664850:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789136019.664860:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3314:x1876044723350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136019.665022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723350784:0@lo:400:kworker.0 00000100:00100000:3.0:1789136019.665068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136019.665112:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350784 00000100:00100000:3.0:1789136019.665116:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350784 00000100:00100000:3.0:1789136019.665164:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789136019.665169:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876044723350784:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136019.665176:0:8031:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136019.665215:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba07378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876044723350784:12345-0@lo:400:kworker.0 Request processed in 44us (149us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136019.665219:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba058d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:317c9ab4-7b59-4637-bad5-b8f09ce47a6a+14:3314:x1876044723350528:12345-0@lo:400:kworker.0 Request processed in 361us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136019.665223:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789136019.665225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1789136019.665291:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136019.665296:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789136019.665299:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789136019.665305:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136019.665308:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 263 00000100:00080000:1.0:1789136019.665326:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b9f463a1800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:1.0:1789136019.665494:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba073c8f840 x1876044723350912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136019.665556:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723350912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789136019.665585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136019.665636:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723350912 00000100:00100000:0.0:1789136019.665640:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723350912 00000100:00100000:0.0:1789136019.665662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789136019.665667:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723350912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789136019.665683:0:5852:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136019.665761:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c0992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723350784:0@lo:400:kworker.0 00000100:00100000:1.0:1789136019.665795:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3314:1876044723350528:0@lo:400:kworker.0 00000100:00080000:2.0:1789136019.677310:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b9f45963000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136019.677340:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 239 00000100:00080000:2.0:1789136019.677351:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b9f45963000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789136019.677396:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072eef840 x1876044723351040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136019.677474:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723351040:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789136019.677545:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136019.677956:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723350656:0@lo:400:kworker.0 00000100:00100000:1.0:1789136019.678141:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723351040 00000100:00100000:1.0:1789136019.678162:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723351040 00000100:00100000:1.0:1789136019.678203:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789136019.678211:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723351040:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789136019.678230:0:5850:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136019.686790:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723351040:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 8566us (9231us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136019.686805:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789136019.692647:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f45963000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136019.692662:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136019.692666:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723351040:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789136019.693747:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723350912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28073us (28155us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136019.693760:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789136019.694033:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136019.694114:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136019.694120:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723350912:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1789136020.301818:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789136020.684908:0:13436:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba06aa11d80 - data ffff8ba06e165948/ffff8ba076474800 00000020:01000000:3.0:1789136020.685102:0:13436:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba045414060 - data ffff8ba0442500d8/ffff8ba076401400 00000001:00000004:3.0:1789136020.700279:0:13436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789136020.801044:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789136020.801054:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789136020.801168:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789136020.801172:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136020.802409:0:7028:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136020.802422:0:7028:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789136020.802432:0:7028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789136020.809557:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789136020.809567:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789136020.809643:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789136020.809647:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789136020.816319:0:8029:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789136020.816330:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789136020.816396:0:8029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789136020.962140:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d16 00000020:00000080:2.0:1789136020.962158:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba043461000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136020.962329:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043461000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789136020.966785:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d2b 00000020:00000080:2.0:1789136020.966805:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba074369000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789136020.966827:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789136020.966834:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136020.966858:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789136020.966865:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ba074361a48) has no exports 00000020:00000080:0.0:1789136020.966868:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba074369000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1789136020.967122:0:13436:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789136020.967134:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f69 00000020:00000080:2.0:1789136020.967140:0:13436:0:(genops.c:885:class_export_put()) final put ffff8b9f463a0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789136020.968308:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789136020.968317:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136020.968326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f463a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789136020.968457:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789136020.968462:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ba04918b490) has no exports 00000020:00000080:2.0:1789136020.968470:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f62 00000020:00000080:2.0:1789136020.968477:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba043467800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136020.968767:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043467800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789136020.969831:0:13436:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789136020.969839:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789136020.969844:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789136020.969854:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789136020.969856:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136020.969912:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136020.969922:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136020.969931:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e82 00000020:00000080:2.0:1789136020.969941:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba073db3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136020.969942:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba0491ee800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789136020.969952:0:38:0:(genops.c:885:class_export_put()) final put ffff8b9f478e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789136020.969955:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789136020.969956:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f478e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789136020.969963:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:01000000:0.0:1789136020.969969:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136020.969970:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789136020.969976:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ba074338000) has no exports 00000020:00000080:2.0:1789136020.969982:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e7b 00000020:00000080:2.0:1789136020.969986:0:13436:0:(genops.c:885:class_export_put()) final put ffff8b9f4724e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136020.970096:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba073db3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136020.970103:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789136020.970673:0:13436:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789136020.970677:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789136020.970680:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789136020.970684:0:13436:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789136020.970686:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136020.970741:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136020.970756:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136020.970770:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f47248800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136020.970778:0:37:0:(genops.c:885:class_export_put()) final put ffff8b9f456b0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136020.970782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f456b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789136020.970787:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:01000000:0.0:1789136020.970791:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136020.970792:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136020.970798:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba043460000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789136020.970801:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043460000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789136020.970807:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136020.970965:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d32 00000020:00000080:2.0:1789136020.970971:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba07436d000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789136020.970990:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789136020.970994:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136020.970998:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789136020.971002:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ba074363490) has no exports 00000020:00000080:2.0:1789136020.971030:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136020.971033:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789136020.971037:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d39 00000020:00000080:2.0:1789136020.971040:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba07436b000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789136020.971047:0:13436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba04857c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789136020.971050:0:13436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba04857c800 3 00000020:01000004:2.0:1789136020.971053:0:13436:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ba04857c800 from lustre-MDT0000 00000020:00000080:2.0:1789136020.971066:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136020.971068:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789136020.971070:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba043465000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789136020.971072:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043465000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789136020.971077:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789136020.971106:0:13436:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789136020.971109:0:13436:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789136020.971112:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789136020.971114:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136020.971116:0:13436:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789136020.971123:0:13436:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ba06cb2d800 317c9ab4-7b59-4637-bad5-b8f09ce47a6a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136020.971127:0:13436:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ba0592c9a48) has exports, disconnecting them 00000020:00080000:2.0:1789136020.971131:0:13436:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ba06cb2d800), last request at 1789135745 00000020:00000080:0.0:1789136020.971301:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba07436d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789136020.971306:0:37:0:(genops.c:885:class_export_put()) final put ffff8ba043464000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789136020.971309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba043464000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789136020.971313:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789136020.971442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba07436b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789136020.971741:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95cd7 00000020:00010000:2.0:1789136020.971747:0:13436:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ba06cb2d800: total 0 00000100:00080000:2.0:1789136020.971752:0:13436:0:(import.c:65:import_set_state_nolock()) ffff8ba06cb2c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789136020.971763:0:13436:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba06cb2d800): rc 0 00000020:00080000:2.0:1789136020.971766:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ba0592c9a48) has no exports 00000100:00100000:1.0:1789136020.972063:0:5843:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ba058d6f800:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1789136020.972171:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ba058d6f200:5842] 0 exiting: rc = 1 00000020:00010000:0.0:1789136020.972250:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ba06cb2d800: total 0 00010000:00010000:0.0:1789136020.972285:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ba06cb2d800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789136020.972335:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9e00/0x38eb79866bf96003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95ffc expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972354:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8e00/0x38eb79866bf95def lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95de8 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972369:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba040031400/0x38eb79866bf9602d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf96026 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972383:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9a00/0x38eb79866bf9626b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf96264 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972396:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8400/0x38eb79866bf96279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf96272 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972408:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec8a00/0x38eb79866bf95fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95fd2 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972419:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5400/0x38eb79866bf95ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95fee expref: 3 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972431:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba044ec9c00/0x38eb79866bf95fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x38eb79866bf95fe0 expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136020.972441:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ba06cb2d800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789136020.972454:0:5838:0:(genops.c:885:class_export_put()) final put ffff8ba06cb2d800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a 00010000:00010000:0.0:1789136020.972610:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136020.972613:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136020.972615:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136020.972648:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ba0473e9000:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1789136020.972881:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972890:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972897:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972903:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972908:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972914:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972920:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972925:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972931:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972936:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972944:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972950:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972956:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972960:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972967:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972972:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972977:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972982:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972988:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972993:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.972999:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973004:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973010:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973015:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973021:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973027:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973032:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973037:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973042:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973056:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973061:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973067:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973073:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973078:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973083:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973088:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973094:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973098:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973104:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973111:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973116:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973124:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973129:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973135:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973140:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973145:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973150:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973156:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973161:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973167:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973172:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973177:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973183:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973189:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973193:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973199:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973205:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973210:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973216:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973223:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973229:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973237:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973243:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136020.973249:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789136020.974010:0:13436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789136020.974016:0:13436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1789136020.977511:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba06cb2d800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a for MGS 00000020:00000080:1.0:1789136020.977569:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba06cb2c800 for MGS 00000020:01000000:2.0:1789136020.978477:0:13436:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba0508297e0 - data ffff8ba07a3e2a20/ffff8b9f47247800 00000020:01000000:2.0:1789136020.978670:0:13436:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba044e178a0 - data ffff8ba07a3c8a20/ffff8ba062116000 00000020:00000080:2.0:1789136020.979223:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95cbb 00000020:00000080:2.0:1789136020.979231:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba042ff2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789136020.984013:0:13436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba04857c800 from MGS, refs=2 00000020:01000004:2.0:1789136020.984025:0:13436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba04857c800 2 00000020:01000004:2.0:1789136020.984029:0:13436:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ba04857c800 from MGS 00000020:00000080:2.0:1789136020.984060:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136020.984070:0:13436:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789136020.984304:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba042ff2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789136020.984955:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba042ff0800/MGS 00000020:00000080:2.0:1789136020.984960:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba042ff0800/MGS for MGS 00000020:01000000:2.0:1789136020.984973:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789136020.985070:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789136020.985076:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136020.985084:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789136020.985093:0:13436:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ba07435b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136020.985101:0:13436:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ba04918ced8) has exports, disconnecting them 00000020:00080000:2.0:1789136020.985107:0:13436:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ba07435b800), last request at 1789135746 00000020:00000080:2.0:1789136020.985113:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95d86 00000020:00080000:2.0:1789136020.985128:0:13436:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ba07435b800): rc 0 00000020:00000080:2.0:1789136020.985133:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba07435b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789136020.986795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba07435b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789136020.988909:0:13436:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789136020.988918:0:13436:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136020.988922:0:13436:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136020.988930:0:13436:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136020.989027:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba0736b9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789136020.989212:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136020.989220:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789136020.989225:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba07643b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789136020.989229:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba07643b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789136020.989235:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789136020.989319:0:13436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba04857c800 1 00000020:00000080:0.0:1789136020.989325:0:13436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95cad 00000020:00000080:0.0:1789136020.989331:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba042ff6800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789136020.989346:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789136020.989351:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136020.989355:0:13436:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136020.989359:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ba0503b4ed8) has no exports 00000020:00000080:1.0:1789136020.989427:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba042ff6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789136021.033375:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136021.033391:0:13436:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789136021.033398:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba048578000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789136021.033403:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba048578000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789136021.033469:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789136021.033603:0:13436:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ba04857e000 00000020:01000000:1.0:1789136021.033632:0:13436:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789136021.033637:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136021.033642:0:13436:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136021.033646:0:13436:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ba0592cb490) has no exports 00000100:00100000:1.0:1789136021.034129:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ba05c023e00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789136021.034484:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ba058268400:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1789136021.034544:0:8031:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ba049178e00:8031] 3 exiting: rc = 0 00000100:00100000:1.0:1789136021.034835:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ba0457bc200:5852] 2 exiting: rc = 0 00000100:00100000:1.0:1789136021.034901:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034908:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034914:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034920:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034926:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034931:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034937:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034942:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034946:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034952:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034956:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034962:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034968:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034973:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034979:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034984:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034991:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.034997:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035003:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035009:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035014:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035021:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035026:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035033:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035039:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035046:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035052:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035058:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035064:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035071:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035076:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035081:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035086:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035091:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035106:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035112:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035116:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035123:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035128:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035134:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035139:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035252:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035261:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035267:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035273:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035279:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035294:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035301:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035306:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035312:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035317:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035322:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035328:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035333:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035339:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035344:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035350:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035355:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035360:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035365:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035370:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035377:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035382:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.035388:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136021.041873:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ba0457bdc00:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1789136021.043138:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ba0457bd000:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1789136021.043370:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043378:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043384:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043390:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043397:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043482:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043488:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043494:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043500:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043507:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043513:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043519:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043526:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043531:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043536:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043542:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043547:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043552:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043558:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043563:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043568:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043573:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043579:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043584:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043589:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043594:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043599:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043603:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043608:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043612:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043617:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043621:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043626:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043631:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043636:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043641:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043645:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043650:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043655:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043660:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043674:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043679:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043684:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043688:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.043692:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044091:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044101:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044106:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044111:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044117:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044122:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044127:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044132:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044137:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044143:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044224:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044229:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044234:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044239:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044243:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044247:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044252:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044257:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.044262:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.044954:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ba04578da00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789136021.045079:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ba04578d800:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1789136021.045130:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045137:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045142:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045218:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045225:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045231:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045236:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045241:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045247:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045252:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045269:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045275:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045281:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045297:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045303:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045322:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045329:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045335:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045341:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045347:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045353:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045359:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045365:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045370:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045376:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045381:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045387:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045482:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045491:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045497:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045504:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045511:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045517:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045522:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045527:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045532:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045538:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045543:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045548:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045568:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045577:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045583:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045589:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045595:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045600:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045614:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045619:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045627:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045633:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045639:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045645:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045663:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045670:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045676:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045681:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045688:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045694:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045842:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045849:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045855:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045861:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045867:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045872:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.045879:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.071609:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ba0457bd600:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1789136021.071999:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ba04578ca00:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1789136021.072193:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072201:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072206:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072212:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072217:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072222:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072227:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072232:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072237:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072243:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072249:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072254:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072270:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072275:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072281:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072301:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072308:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072313:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072319:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072323:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072329:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072334:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072339:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072344:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072350:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072356:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072362:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072368:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072374:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072379:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072385:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072390:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072396:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072401:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072563:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072571:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072577:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072585:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072591:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072600:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072608:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072616:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072622:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072628:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072634:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072639:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072645:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072657:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072662:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072668:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072674:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072678:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072682:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072687:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072693:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072921:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072931:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072941:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072946:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072984:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072993:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.072999:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.073006:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.073013:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136021.073680:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ba045782200:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1789136021.073685:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ba0457bd200:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1789136021.076895:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076905:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076913:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076919:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076927:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076935:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076943:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076949:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076956:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076963:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076969:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076977:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076984:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076989:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.076996:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077002:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077009:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077015:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077039:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077049:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077058:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077063:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077068:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077081:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077087:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077092:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077096:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077102:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077107:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077112:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077117:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077122:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077127:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077132:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077136:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077141:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077280:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077298:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077304:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077309:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077314:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077319:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077324:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077329:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077334:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077338:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077343:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077348:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077354:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077359:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077363:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077369:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077374:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077387:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077393:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077399:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077523:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077528:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077533:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077539:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077545:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077549:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077555:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.077561:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136021.078245:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ba047e79a00:5861] 0 exiting: rc = 1 00000100:00100000:1.0:1789136021.078591:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ba045786e00:5862] 1 exiting: rc = 0 00000100:00100000:0.0:1789136021.078673:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078680:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078685:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078690:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078695:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078719:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078726:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078731:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078736:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078741:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078746:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078752:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078759:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078764:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078770:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078774:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078779:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078785:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078790:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078794:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078800:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078805:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078810:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078815:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078833:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078839:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078844:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078850:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078856:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078862:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078867:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078872:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078876:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078881:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078886:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078891:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078895:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078900:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078904:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078909:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078914:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078919:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078924:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078929:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078933:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078938:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078942:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078947:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078953:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078957:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078962:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078967:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078972:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078977:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078981:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078986:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078991:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.078996:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079000:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079014:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079019:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079024:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079029:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.079035:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136021.080663:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ba045788600:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1789136021.080754:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ba045789e00:5863] 0 exiting: rc = 1 00000100:00100000:1.0:1789136021.081362:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ba045786c00:5865] 2 exiting: rc = 0 00000100:00100000:0.0:1789136021.081663:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081673:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081679:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081684:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081689:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081863:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081876:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081883:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081895:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081901:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081907:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081913:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081947:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081954:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081961:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081969:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081976:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081984:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081991:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.081998:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082005:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082013:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082020:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082027:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082057:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082065:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082073:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082080:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082088:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082095:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082115:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082123:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082133:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082140:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082237:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082247:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082254:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082262:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082269:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082277:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082294:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082303:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082311:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082318:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082326:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082334:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082342:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082349:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082382:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082390:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082676:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082687:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082693:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082880:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082890:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082926:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082934:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082940:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082946:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082952:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082958:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082965:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082971:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136021.082978:0:13436:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789136021.091624:0:13436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136021.091638:0:13436:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789136021.091645:0:13436:0:(genops.c:885:class_export_put()) final put ffff8ba059386800/MDS_uuid 00000020:00000080:1.0:1789136021.091650:0:13436:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba059386800/MDS_uuid for MDS 00000020:01000000:1.0:1789136021.091656:0:13436:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789136021.094102:0:13436:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1789136021.300105:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136021.300117:0:7663:0:(genops.c:885:class_export_put()) final put ffff8b9f463a6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136021.300150:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f463a6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789136021.300199:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f463a0800 for lustre-OST0001 00010000:00010000:2.0:1789136021.324935:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136022.348902:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136023.379868:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136024.073395:0:13591:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789136024.099198:0:13591:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789136024.099259:0:13591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136024.099273:0:13591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136024.099281:0:13591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136024.099288:0:13591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136024.099352:0:13591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789136024.099357:0:13591:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789136024.099382:0:13591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136024.099387:0:13591:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789136024.099450:0:13591:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136024.099458:0:13591:0:(import.c:65:import_set_state_nolock()) ffff8b9f45963000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789136024.099463:0:13591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136024.099465:0:13591:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789136024.099468:0:13591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789136024.105249:0:13591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.105288:0:13591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.105295:0:13591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.105302:0:13591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105406:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136024.105414:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105431:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136024.105435:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105444:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136024.105451:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136024.105457:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136024.105460:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789136024.105463:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789136024.105504:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105511:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136024.105546:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105553:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031e00/0x38eb79866bf95fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf95ff5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136024.105575:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136024.105595:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723351168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136024.105673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136024.105749:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136024.105759:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105766:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba044ec8800 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136024.105768:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105775:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136024.105781:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136024.105786:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136024.105789:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789136024.105803:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.105808:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136024.105825:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136024.105840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723351296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136024.105865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136024.105891:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136024.105893:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136024.105895:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136024.107343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723351168 00000100:00100000:3.0:1789136024.107356:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723351168 00000100:00100000:3.0:1789136024.107421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723351296 00000100:00100000:3.0:1789136024.107425:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723351296 00000100:00100000:3.0:1789136024.107449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136024.107457:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1876044723351168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789136024.107465:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136024 with bad export cookie 4101505503895051479 00000100:00100000:0.0:1789136024.109090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789136024.109103:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1876044723351296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789136024.109112:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136024 with bad export cookie 4101505503895051479 00000100:00100000:0.0:1789136024.109257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1876044723351296:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (3389us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136024.109265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789136024.109427:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136024.109434:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8ba059386000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789136024.109445:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789136024.114195:0:13591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789136024.114212:0:13591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8800/0x38eb79866bf95ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96003 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.114253:0:13591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.114263:0:13591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.114269:0:13591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.114276:0:13591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136024.114296:0:13591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789136024.114301:0:13591:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789136024.114305:0:13591:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789136024.114354:0:13591:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789136024.114371:0:13591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789136024.114377:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136024.114383:0:13591:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789136024.114388:0:13591:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ba0503b3490) has no exports 00000020:00080000:2.0:1789136024.114736:0:13591:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ba0503b3490) has no exports 00010000:00010000:0.0:1789136024.116551:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136024.116566:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.116579:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cce00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136024.116584:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.116595:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136024.116604:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136024.116611:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789136024.116614:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789136024.116617:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:2.0:1789136024.117685:0:13591:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba050209180 - data ffff8ba06e093a20/ffff8ba0741ea800 00000020:01000000:2.0:1789136024.117998:0:13591:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba04705cd20 - data ffff8ba042123af8/ffff8b9f458f0c00 00000100:00100000:3.0:1789136024.128219:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1876044723351168:12345-0@lo:103:ldlm_bl.0 Request processed in 20754us (22538us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136024.128260:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789136024.129074:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1789136024.129757:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136024.149444:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.141@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789136024.149450:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789136024.149461:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba05c098f00 x1876044723351168/t0(0) o103->MGC192.168.204.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136040 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136024.149477:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba05c098780 x1876044723351296/t0(0) o103->MGC192.168.204.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136040 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789136024.149487:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789136024.149490:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789136024.149492:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1789136024.149874:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.149885:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136024.149910:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.149919:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cce00/0x38eb79866bf96272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x38eb79866bf96279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136024.149937:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136024.149952:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136024.149955:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136024.149974:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:0:1876044723351424:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789136024.150650:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ba059386000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1789136024.150996:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8ba059386000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136024.151004:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.204.141@tcp: connect to NID 0@lo last attempt 219 00000100:00080000:1.0:1789136024.151014:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.204.141@tcp: import ffff8ba059386000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789136024.151039:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3311:1876044723351168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136024.151946:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c09b0c0 x1876044723351552/t0(0) o250->MGC192.168.204.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136024.151982:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3313:1876044723351296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136024.152121:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3310:1876044723351552:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789136024.152192:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044723351552 offset 0 length 520: 4 00100000:10000000:3.0:1789136024.176801:0:13591:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789136024.295361:0:13591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e0b 00000020:00000080:0.0:1789136024.295374:0:13591:0:(genops.c:885:class_export_put()) final put ffff8b9f456b5800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789136024.295410:0:13591:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba0504e6000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789136024.295414:0:13591:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba0504e6000 2 00000020:01000004:0.0:1789136024.295417:0:13591:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ba0504e6000 from lustre-OST0000 00000020:00000080:0.0:1789136024.295440:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136024.295450:0:13591:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789136024.295452:0:13591:0:(genops.c:885:class_export_put()) final put ffff8ba07435a000/lustre-OST0000_UUID 00000020:00000080:0.0:1789136024.295455:0:13591:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba07435a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789136024.295462:0:13591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789136024.295504:0:13591:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789136024.295509:0:13591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789136024.295513:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136024.295517:0:13591:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136024.295524:0:13591:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8b9f45940000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136024.295529:0:13591:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8ba0503b0000) has exports, disconnecting them 00000020:00080000:0.0:1789136024.295533:0:13591:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8b9f45940000), last request at 1789135765 00000020:00000080:0.0:1789136024.295537:0:13591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95e35 00000020:00000080:2.0:1789136024.295725:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f456b5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1789136024.296170:0:13591:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b9f45940000): rc 0 00000020:00000080:0.0:1789136024.296177:0:13591:0:(genops.c:885:class_export_put()) final put ffff8b9f45940000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789136024.297151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f45940000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789136024.297453:0:13591:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789136024.297458:0:13591:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136024.297478:0:13591:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136024.297484:0:13591:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136024.297805:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136024.297811:0:13591:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789136024.297818:0:13591:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba0504e6000 1 00000020:00000080:0.0:1789136024.297822:0:13591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95dc5 00000020:00000080:0.0:1789136024.297907:0:13591:0:(genops.c:885:class_export_put()) final put ffff8ba0504e4000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789136024.297913:0:13591:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789136024.297918:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136024.297922:0:13591:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136024.297926:0:13591:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ba07433ced8) has no exports 00000020:00000080:1.0:1789136024.298024:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f45963000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789136024.298031:0:38:0:(genops.c:885:class_export_put()) final put ffff8b9f456b1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789136024.298033:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f456b1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789136024.298191:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789136024.298261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0504e4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789136024.325187:0:13591:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136024.325210:0:13591:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789136024.325218:0:13591:0:(genops.c:885:class_export_put()) final put ffff8ba0504e6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789136024.325234:0:13591:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0504e6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789136024.325246:0:13591:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789136024.325417:0:13591:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ba0504e4800 00000020:02000400:1.0:1789136024.325470:0:13591:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789136024.410509:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136024.782853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 317c9ab4-7b59-4637-bad5-b8f09ce47a6a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789136024.782865:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 317c9ab4-7b59-4637-bad5-b8f09ce47a6a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136024.782879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789136024.782882:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789136024.782886:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136024.782895:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1789136024.782901:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789136024.782908:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b9f463a1800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:1.0:1789136024.782945:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba073c8d680 x1876044723351680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136024.783034:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723351680:0@lo:38:kworker.0 00000400:00000100:3.0:1789136024.783112:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044723351680 offset 0 length 520: 4 00010000:00010000:1.0:1789136025.424591:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136026.446137:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789136027.329396:0:13742:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136027.345920:0:13742:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789136027.346010:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.346027:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.346035:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.346042:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.346064:0:13742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136027.346069:0:13742:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136027.346100:0:13742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136027.346112:0:13742:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba073c8d680 x1876044723351680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136027.346129:0:13742:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136027.346149:0:13742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136027.346156:0:13742:0:(import.c:65:import_set_state_nolock()) ffff8b9f463a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136027.346160:0:13742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136027.346176:0:13742:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba073c8d680 x1876044723351680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136039 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136027.346184:0:13742:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136027.346187:0:13742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1789136027.346254:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136027.346261:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.346267:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0fa00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136027.346271:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.346279:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136027.346286:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136027.346291:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136027.346293:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789136027.346296:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789136027.346309:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ba059386000 00010000:00010000:0.0:1789136027.346313:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.346331:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fa00/0x38eb79866bf95fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf95fd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.346343:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136027.346344:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136027.346346:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136027.346425:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723351680:0@lo:38:kworker.0 00010000:00010000:1.0:1789136027.350397:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350419:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350427:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350434:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350524:0:13742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136027.350532:0:13742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350539:0:13742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350545:0:13742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136027.350550:0:13742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351178:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136027.351188:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351197:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba040031000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136027.351201:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351210:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136027.351218:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136027.351223:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136027.351226:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789136027.351239:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ba059386000 00010000:00010000:0.0:1789136027.351243:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351297:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040031000/0x38eb79866bf95fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf95fe7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351328:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136027.351332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351338:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0862cc000 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136027.351341:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351348:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136027.351354:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136027.351359:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789136027.351361:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789136027.351366:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ba059386000 00010000:00010000:0.0:1789136027.351369:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.351376:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136027.351378:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136027.351380:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136027.351583:0:13742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136027.351590:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0862cc000/0x38eb79866bf96264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf9626b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136027.351616:0:13742:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789136027.351623:0:13742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1789136027.351627:0:13742:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789136027.351653:0:13742:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789136027.351657:0:13742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789136027.352318:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136027.352326:0:13742:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136027.352331:0:13742:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ba074339a48) has no exports 00000020:00080000:1.0:1789136027.352549:0:13742:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ba074339a48) has no exports 00010000:00010000:0.0:1789136027.357121:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789136027.357246:0:13742:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba06aa11ba0 - data ffff8ba06e165438/ffff8ba076476c00 00000020:01000000:1.0:1789136027.357431:0:13742:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8ba0732c4300 - data ffff8ba07a3216c0/ffff8b9f410f8800 00100000:10000000:3.0:1789136027.375278:0:13742:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789136027.437027:0:13742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95ed6 00000020:00000080:0.0:1789136027.437038:0:13742:0:(genops.c:885:class_export_put()) final put ffff8ba071cf1000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789136027.437094:0:13742:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b9f45966800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789136027.437098:0:13742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b9f45966800 2 00000020:01000004:0.0:1789136027.437101:0:13742:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b9f45966800 from lustre-OST0001 00000020:00000080:0.0:1789136027.437153:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136027.437174:0:13742:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789136027.437178:0:13742:0:(genops.c:885:class_export_put()) final put ffff8b9f4724c000/lustre-OST0001_UUID 00000020:00000080:0.0:1789136027.437182:0:13742:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789136027.437194:0:13742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789136027.437415:0:13742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 317c9ab4-7b59-4637-bad5-b8f09ce47a6a->MGS 00010000:00010000:0.0:1789136027.437434:0:13742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136027.437446:0:13742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136027.437453:0:13742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789136027.437456:0:13742:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789136027.437459:0:13742:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789136027.437475:0:13742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ba059386000 00010000:00010000:0.0:1789136027.437479:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba040030000/0x38eb79866bf95de8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf95def expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136027.437493:0:13742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136027.437500:0:13742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136027.437505:0:13742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136027.437507:0:13742:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789136027.437509:0:13742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789136027.437517:0:13742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ba059386000 00010000:00010000:0.0:1789136027.437520:0:13742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba044ec8200/0x38eb79866bf96026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x38eb79866bf9602d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789136027.437545:0:13742:0:(import.c:65:import_set_state_nolock()) ffff8ba059386000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789136027.437549:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789136027.437552:0:13742:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789136027.437553:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789136027.437557:0:13742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789136027.437568:0:13742:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ba05c09b0c0 x1876044723351552/t0(0) o250->MGC192.168.204.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789136034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789136027.437749:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789136027.437753:0:13742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1789136027.437805:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba071cf1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789136027.437853:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:317c9ab4-7b59-4637-bad5-b8f09ce47a6a:3310:1876044723351552:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1789136027.437917:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789136027.437925:0:13742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95cc9 00000020:00000080:0.0:1789136027.437930:0:13742:0:(genops.c:885:class_export_put()) final put ffff8ba059380800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a 00000020:01000000:0.0:1789136027.437945:0:13742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.141@tcp (flags='') 00000020:00000080:0.0:1789136027.437952:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136027.437957:0:13742:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789136027.437961:0:13742:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ba0592cced8) has no exports 10000000:01000000:0.0:1789136027.437979:0:5846:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789136027.438031:0:13742:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.141@tcp: client import never connected 00000100:00080000:0.0:1789136027.438033:0:13742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789136027.438036:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789136027.438037:0:13742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789136027.438039:0:13742:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789136027.438067:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136027.438071:0:13742:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.141@tcp (uuid 317c9ab4-7b59-4637-bad5-b8f09ce47a6a) 00000020:01000000:0.0:1789136027.438076:0:13742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789136027.438079:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136027.438082:0:13742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136027.438087:0:13742:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8b9f463a3000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136027.438092:0:13742:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8b9f465c0000) has exports, disconnecting them 00000020:00080000:0.0:1789136027.438096:0:13742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8b9f463a3000), last request at 1789135789 00000020:00000080:0.0:1789136027.438107:0:13742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95f00 00000020:00080000:0.0:1789136027.438118:0:13742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b9f463a3000): rc 0 00000020:00000080:0.0:1789136027.438122:0:13742:0:(genops.c:885:class_export_put()) final put ffff8b9f463a3000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789136027.438720:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba059380800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a for MGC192.168.204.141@tcp 00000020:00000080:3.0:1789136027.438731:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f463a3000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789136027.440822:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ba059386000 for MGC192.168.204.141@tcp 00000020:00000080:1.0:1789136027.440835:0:38:0:(genops.c:885:class_export_put()) final put ffff8ba059384800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a 00000020:00000080:1.0:1789136027.440839:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba059384800/317c9ab4-7b59-4637-bad5-b8f09ce47a6a for MGC192.168.204.141@tcp 00000020:01000000:1.0:1789136027.440854:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.141@tcp (317c9ab4-7b59-4637-bad5-b8f09ce47a6a) 00010000:01000000:1.0:1789136027.441769:0:13742:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789136027.441775:0:13742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136027.441779:0:13742:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136027.441786:0:13742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136027.442252:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b9f463a1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789136027.445776:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789136027.446412:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1789136027.446851:0:7650:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff8b9f47315800:7650] 3 exiting: rc = 0 00000100:00100000:1.0:1789136027.446931:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ba06ca91400:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1789136027.447006:0:6722:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8b9f458f7e00:6722] 2 exiting: rc = 0 00000100:00100000:0.0:1789136027.447247:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ba06ca90c00:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1789136027.447387:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.447748:0:6713:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8b9f4558d400:6713] 3 exiting: rc = 0 00000100:00100000:3.0:1789136027.447808:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ba044b25000:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1789136027.448075:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ba06ca91800:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1789136027.448178:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ba06ca91a00:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1789136027.448324:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448331:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448337:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448343:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448348:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448353:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448358:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448364:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448377:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448382:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448388:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448395:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448401:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448406:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448413:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448418:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448424:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448432:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448438:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448443:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448449:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448454:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448462:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448467:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448474:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448479:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448484:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448489:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448496:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448501:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448506:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448512:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448517:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448521:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448528:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448532:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448537:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448542:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448547:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448552:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448558:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448563:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448568:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448582:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448587:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448592:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448598:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448673:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448683:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448688:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448693:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448736:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448745:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448750:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448755:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448760:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448769:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448774:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448778:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448783:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448788:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448792:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448797:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.448803:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789136027.450143:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136027.450155:0:13742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789136027.450161:0:13742:0:(genops.c:885:class_export_put()) final put ffff8ba0736bf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789136027.450175:0:13742:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0736bf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789136027.450186:0:13742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789136027.450228:0:13742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b9f45966800 1 00000020:00000080:3.0:1789136027.450233:0:13742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x38eb79866bf95ea5 00000020:00000080:3.0:1789136027.450240:0:13742:0:(genops.c:885:class_export_put()) final put ffff8b9f4724b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789136027.450251:0:13742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789136027.450261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f4724b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789136027.450272:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136027.450276:0:13742:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136027.450683:0:13742:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ba0503b1a48) has no exports 00000020:00000080:3.0:1789136027.464378:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136027.464395:0:13742:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789136027.464402:0:13742:0:(genops.c:885:class_export_put()) final put ffff8b9f45960800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789136027.464407:0:13742:0:(genops.c:844:class_export_destroy()) destroying export ffff8b9f45960800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789136027.464414:0:13742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789136027.465199:0:13742:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b9f45967000 00000020:01000000:3.0:1789136027.465225:0:13742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789136027.465230:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136027.465234:0:13742:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136027.465238:0:13742:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ba07433b490) has no exports 00000020:00000080:3.0:1789136027.465267:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136027.465273:0:13742:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789136027.465276:0:13742:0:(genops.c:885:class_export_put()) final put ffff8ba0504e2800/OSS_uuid 00000020:00000080:3.0:1789136027.465278:0:13742:0:(genops.c:844:class_export_destroy()) destroying export ffff8ba0504e2800/OSS_uuid for OSS 00000020:01000000:3.0:1789136027.465281:0:13742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789136027.465383:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789136027.465736:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ba074160800:8442] 3 exiting: rc = 0 00000100:00100000:3.0:1789136027.465810:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ba058268000:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1789136027.466421:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ba072618e00:6700] 2 exiting: rc = 0 00000100:00100000:3.0:1789136027.466466:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ba058269c00:6697] 0 exiting: rc = 1 00000100:00100000:3.0:1789136027.466525:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466533:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466538:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466544:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466550:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466555:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466561:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466566:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466571:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466576:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466580:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.466585:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467235:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467249:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467255:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467261:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467266:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467271:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467276:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467281:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467298:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467304:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467309:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467314:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467318:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467323:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467327:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467333:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467338:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467342:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467347:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467351:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467357:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467362:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467367:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467372:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467378:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467383:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467388:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467393:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467398:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467404:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467408:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467413:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467418:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467424:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467430:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467448:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467455:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467461:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467466:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467471:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467476:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467481:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467486:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467491:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467496:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467502:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467507:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467511:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467516:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467522:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467527:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.467532:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136027.468815:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ba073151800:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1789136027.479817:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ba073151a00:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1789136027.479947:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479956:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479962:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479977:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479982:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479987:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479992:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.479998:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480003:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480008:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480014:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480019:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480024:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480032:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480037:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480042:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480047:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480066:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480071:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480082:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480086:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480090:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480095:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480100:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480104:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480110:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480114:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480120:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480125:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480131:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480136:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480141:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480146:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480152:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480157:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480162:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480179:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480185:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480190:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480194:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480199:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480204:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480208:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480214:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480219:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480225:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480230:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480235:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480240:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480245:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480250:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480255:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480269:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480274:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480280:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480295:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480300:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480305:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480310:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480315:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480320:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480325:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480331:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.480337:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.481730:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ba073df8000:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1789136027.482114:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ba072521000:6705] 2 exiting: rc = 0 00000100:00100000:1.0:1789136027.482829:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ba073150200:6703] 0 exiting: rc = 1 00000100:00100000:3.0:1789136027.486093:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486104:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486110:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486116:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486122:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486128:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486133:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486139:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486144:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486150:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486156:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486162:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486180:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486185:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486191:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486197:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486202:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486208:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486214:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486219:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486225:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486232:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486259:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486266:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486273:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486280:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486359:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486366:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486388:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486397:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486403:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486409:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486415:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486421:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486426:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486432:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486438:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486444:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486450:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486456:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486461:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486467:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486473:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486478:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486485:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486492:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486498:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486504:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486510:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486515:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486521:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486529:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486535:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486541:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486546:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486552:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486573:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486585:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486591:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486597:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486749:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486759:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486765:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.486771:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.501696:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ba071ce5200:6707] 1 exiting: rc = 0 00000100:00100000:1.0:1789136027.501836:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ba072521a00:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1789136027.502456:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502463:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502469:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502475:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502480:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502486:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502769:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502776:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502782:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502788:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502794:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502800:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502805:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502811:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502815:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502819:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502825:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502829:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502834:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502839:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502843:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502848:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502853:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502858:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502862:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502868:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502874:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502906:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502912:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502917:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502922:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502927:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502932:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502937:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502942:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502947:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502952:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502956:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.502961:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503041:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503047:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503051:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503057:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503061:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503066:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503071:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503077:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503083:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503089:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503094:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503100:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503105:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503110:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503115:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503121:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503126:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503131:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503136:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503142:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503146:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503151:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503156:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503179:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.503184:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136027.504226:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ba073df8c00:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1789136027.504475:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ba073df9200:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1789136027.504579:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504588:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504594:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504601:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504608:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504613:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504619:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504625:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504631:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504637:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504643:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504649:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504656:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504662:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504669:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504689:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504723:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504730:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504737:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504744:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504750:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504756:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504763:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504769:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504776:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504782:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504789:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504809:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504816:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504821:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504827:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504833:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504839:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504855:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504861:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504867:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504873:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504890:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504897:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504918:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504925:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504931:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504937:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504943:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504949:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504955:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.504961:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505044:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505050:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505056:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505062:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505083:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505091:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505097:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505103:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505109:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505115:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505121:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505127:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505135:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505140:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505147:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505153:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136027.505185:0:13742:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789136027.525920:0:13742:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789136046.982676:0:14354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789136056.629175:0:14815:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136056.629180:0:14815:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789136056.629293:0:14815:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba073580000 00000020:01000004:3.0:1789136056.629308:0:14815:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789136056.629316:0:14815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789136056.629330:0:14815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ba074360000) 00000020:00000080:3.0:1789136056.629342:0:14815:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789136056.663418:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789136056.679642:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789136056.680311:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789136056.682541:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 513: rc = 0 00100000:10000000:2.0:1789136056.683945:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 513: rc = 0 00100000:10000000:2.0:1789136056.684049:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1789136056.684152:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:2.0:1789136056.684256:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1789136056.684680:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1789136056.685249:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 515: rc = 0 00100000:10000000:2.0:1789136056.690871:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 250: rc = 0 00100000:10000000:2.0:1789136056.690983:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 250: rc = 0 00100000:10000000:3.0:1789136056.692191:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.693917:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 455: rc = 0 00100000:10000000:3.0:1789136056.694197:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.696168:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 455: rc = 0 00100000:10000000:3.0:1789136056.697772:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.698083:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 455: rc = 0 00100000:10000000:3.0:1789136056.699901:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 455: rc = 0 00100000:10000000:3.0:1789136056.700420:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.703321:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 455: rc = 0 00100000:10000000:3.0:1789136056.706743:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.707053:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 455: rc = 0 00100000:10000000:3.0:1789136056.707314:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789136056.707868:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 675: rc = 0 00100000:10000000:3.0:1789136056.714998:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 675: rc = 0 00100000:10000000:3.0:1789136056.715350:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 675: rc = 0 00100000:10000000:3.0:1789136056.715626:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 675: rc = 0 00100000:10000000:3.0:1789136056.715916:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 675: rc = 0 00100000:10000000:3.0:1789136056.716197:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 675: rc = 0 00100000:10000000:3.0:1789136056.716429:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 675: rc = 0 00100000:10000000:3.0:1789136056.716697:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 675: rc = 0 00100000:10000000:3.0:1789136056.716972:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 675: rc = 0 00100000:10000000:3.0:1789136056.717203:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 675: rc = 0 00100000:10000000:3.0:1789136056.717447:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 675: rc = 0 00100000:10000000:3.0:1789136056.723007:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 675: rc = 0 00100000:10000000:3.0:1789136056.723314:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 675: rc = 0 00100000:10000000:3.0:1789136056.723573:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 675: rc = 0 00100000:10000000:3.0:1789136056.723892:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 675: rc = 0 00100000:10000000:3.0:1789136056.724169:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 675: rc = 0 00100000:10000000:3.0:1789136056.724431:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 675: rc = 0 00100000:10000000:2.0:1789136056.733450:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 675: rc = 0 00100000:10000000:2.0:1789136056.734224:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 675: rc = 0 00100000:10000000:2.0:1789136056.734488:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 675: rc = 0 00100000:10000000:2.0:1789136056.734800:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 675: rc = 0 00100000:10000000:2.0:1789136056.735049:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 675: rc = 0 00100000:10000000:2.0:1789136056.735334:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 675: rc = 0 00100000:10000000:2.0:1789136056.735581:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 675: rc = 0 00100000:10000000:2.0:1789136056.738264:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 675: rc = 0 00100000:10000000:2.0:1789136056.738584:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 675: rc = 0 00100000:10000000:2.0:1789136056.738887:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 675: rc = 0 00100000:10000000:2.0:1789136056.739147:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 675: rc = 0 00100000:10000000:2.0:1789136056.739394:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 675: rc = 0 00100000:10000000:2.0:1789136056.739658:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 675: rc = 0 00100000:10000000:2.0:1789136056.740197:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 675: rc = 0 00100000:10000000:2.0:1789136056.740540:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 675: rc = 0 00100000:10000000:2.0:1789136056.740983:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 664: rc = 0 00100000:10000000:2.0:1789136056.746161:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789136056.746355:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:2.0:1789136056.746900:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789136056.746961:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:2.0:1789136056.747156:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789136056.747209:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:2.0:1789136056.748930:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789136056.749027:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 251: rc = 0 00100000:10000000:2.0:1789136056.749293:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789136056.749364:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 251: rc = 0 00100000:10000000:2.0:1789136056.751029:0:14815:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789136056.751573:0:14815:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 251: rc = 0 00000020:00000080:2.0:1789136056.751923:0:14815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789136056.751940:0:14815:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789136056.751953:0:14815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf97010 00000020:01000004:2.0:1789136056.751963:0:14815:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789136056.751969:0:14815:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789136056.751974:0:14815:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba073580000 from MGS 00000020:01000004:2.0:1789136056.751978:0:14815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789136056.751987:0:14815:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8b9f465c1a48) 00000020:00000080:2.0:1789136056.751996:0:14815:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789136056.752058:0:14815:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba073580000 from MGS, refs=2 00080000:01000000:2.0:1789136056.752063:0:14815:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136056.752069:0:14815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf9701e 00000100:00100000:2.0:1789136056.752182:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789136056.752341:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789136056.752348:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789136056.757981:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789136056.757997:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789136056.760119:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136056.760352:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789136056.760361:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789136056.762178:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789136056.762192:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789136056.768333:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789136056.768350:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789136056.769149:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136056.769153:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136056.769154:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136056.769472:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136056.769475:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136056.769477:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136056.770091:0:14815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789136056.772937:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789136056.800280:0:14815:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789136056.800300:0:14815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789136056.800304:0:14815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789136056.803645:0:14824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789136056.815132:0:14815:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789136056.815273:0:14815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789136056.819234:0:14815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789136056.824089:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136056.824659:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789136056.824667:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789136056.827055:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789136056.827066:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789136056.833019:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789136056.833033:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789136056.834230:0:14815:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789136056.834271:0:14815:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.141@tcp' 00000020:01000004:3.0:1789136056.834274:0:14815:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789136056.834314:0:14815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.141@tcp (typ=mgc) 00000020:00000080:3.0:1789136056.834329:0:14815:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.141@tcp (ffff8ba074363490) 00000020:00000080:3.0:1789136056.834348:0:14815:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789136056.834449:0:14815:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b9f456a6000@MGC192.168.204.141@tcp: add connection 192.168.204.141@tcp at head 00010000:00010000:3.0:1789136056.834630:0:14815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.141@tcp-0 is initialized 00000040:01000000:3.0:1789136056.834644:0:14815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789136056.841408:0:14830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789136056.841510:0:14815:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.141@tcp (uuid 2dc02be1-e923-45bb-814e-7c82b120b447) 00000020:00000080:0.0:1789136056.841536:0:14815:0:(genops.c:1385:class_connect()) connect: client 2dc02be1-e923-45bb-814e-7c82b120b447, cookie 0x38eb79866bf9702c 00000100:00080000:0.0:1789136056.841550:0:14815:0:(import.c:510:import_select_connection()) MGC192.168.204.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136056.841556:0:14815:0:(import.c:624:import_select_connection()) MGC192.168.204.141@tcp: import ffff8b9f456a6000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:0.0:1789136056.841593:0:14815:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c09b840 x1876044723351808/t0(0) o250->MGC192.168.204.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136056.841632:0:14815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2dc02be1-e923-45bb-814e-7c82b120b447->MGS 00000020:01000004:0.0:1789136056.841653:0:14815:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789136056.841674:0:14815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789136056.841689:0:14815:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ba04918ced8) 00000020:00000080:0.0:1789136056.841724:0:14815:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789136056.842380:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2dc02be1-e923-45bb-814e-7c82b120b447:3310:1876044723351808:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789136056.842453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136056.842779:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723351808 00000100:00100000:3.0:1789136056.842788:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723351808 00000100:00100000:3.0:1789136056.842824:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136056.842831:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1876044723351808:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789136056.842857:0:14826:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2dc02be1-e923-45bb-814e-7c82b120b447@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1789136056.842884:0:14826:0:(genops.c:1385:class_connect()) connect: client 2dc02be1-e923-45bb-814e-7c82b120b447, cookie 0x38eb79866bf9703a 00000100:00080000:3.0:1789136056.843029:0:14826:0:(import.c:65:import_set_state_nolock()) ffff8b9f45966800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136056.843084:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+5:3310:x1876044723351808:12345-0@lo:250:mount.lustre.0 Request processed in 252us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136056.843091:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136056.843133:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789136056.843142:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1789136056.843149:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789136056.843153:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789136056.843156:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f456a6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789136056.843159:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789136056.843167:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789136056.843172:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2dc02be1-e923-45bb-814e-7c82b120b447:3310:1876044723351808:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1789136056.849354:0:14829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1789136056.871996:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136056.874214:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136056.874228:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789136056.875547:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789136056.875639:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789136056.877088:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136056.877101:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789136056.878408:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136056.878672:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789136056.878678:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789136056.883313:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789136056.883441:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789136056.927320:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136056.927867:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789136056.927875:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789136056.931838:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789136056.931862:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789136056.932695:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136056.933175:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789136056.933182:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789136056.933867:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789136056.933875:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789136056.934452:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136056.934649:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789136056.934654:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789136056.937590:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789136056.937622:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789136056.938513:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136056.939246:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789136056.939254:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789136056.940305:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789136056.940315:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789136056.960918:0:14815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136056.961192:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136056.961199:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789136056.963928:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789136056.963943:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789136056.970766:0:14815:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789136056.970782:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789136056.974518:0:14815:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789136056.974550:0:14815:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789136056.974558:0:14815:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789136056.977738:0:14815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136056.977808:0:14815:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.141@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789136056.977814:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136056.977815:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136056.977817:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136056.977818:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136056.977819:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136056.977821:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136056.977827:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136056.977828:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136056.977830:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136056.977832:0:14815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136056.977836:0:14815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789136056.977838:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136056.977839:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136056.977840:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136056.977841:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136056.977842:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136056.977843:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136056.977844:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136056.977845:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136056.977846:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136056.977847:0:14815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136056.977882:0:14815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136056.977914:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723351936:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136056.978006:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136056.978083:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba05047ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136056.978270:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723351936 00000100:00100000:1.0:1789136056.978279:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723351936 00000100:00100000:1.0:1789136056.978357:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136056.978366:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+5:14815:x1876044723351936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789136056.978417:0:14828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789136056.978421:0:14828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789136056.978425:0:14828:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789136056.982032:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789136056.982670:0:14828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789136056.985291:0:14850:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789136056.985305:0:14850:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789136056.985309:0:14850:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789136056.985351:0:14850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789136056.988985:0:14828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789136056.989003:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789136057.002414:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+5:14815:x1876044723351936:12345-0@lo:253:mount.lustre.0 Request processed in 24035us (24393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136057.002448:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136057.002689:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723351936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136057.002862:0:14815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789136057.002866:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136057.002868:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136057.002870:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136057.002871:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136057.002872:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136057.002873:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136057.002874:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136057.002876:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136057.002878:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136057.002879:0:14815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136057.002904:0:14815:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba073580000 from lustre-MDT0000 10000000:01000000:2.0:1789136057.002929:0:14815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789136057.002945:0:14815:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789136057.002950:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ba074363490 10000000:01000000:2.0:1789136057.002956:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136057.002964:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ba074363490 from 1 10000000:01000000:2.0:1789136057.002968:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789136057.003010:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.003023:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.003033:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136057.003056:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136057.003100:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.014242:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba069fb6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.018840:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352064 00000100:00100000:0.0:1789136057.018873:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352064 00000100:00100000:0.0:1789136057.018949:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136057.018961:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+5:14815:x1876044723352064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136057.018982:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136057.019007:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba086377800/0x38eb79866bf97048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97041 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.019040:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba086377800/0x38eb79866bf97048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97041 expref: 6 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.019054:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba086377800/0x38eb79866bf97048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97041 expref: 6 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.019064:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba086377800, rc 0) 00000100:00100000:0.0:1789136057.019667:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+6:14815:x1876044723352064:12345-0@lo:101:mount.lustre.0 Request processed in 707us (16565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136057.019675:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136057.025899:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136057.025937:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.025951:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136057.026182:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136057.026249:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.026288:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.026393:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352192 00000100:00100000:0.0:1789136057.026400:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352192 00000100:00100000:0.0:1789136057.026456:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136057.026466:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+6:14815:x1876044723352192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136057.029300:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+6:14815:x1876044723352192:12345-0@lo:501:mount.lustre.0 Request processed in 2826us (3040us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136057.029315:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136057.029564:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352192:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789136057.029625:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789136057.029652:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.029664:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136057.029674:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba073580000 10000000:01000000:3.0:1789136057.029680:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789136057.029684:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ba073580000 10000000:01000000:3.0:1789136057.029686:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789136057.029689:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ba073580000 from 1 10000000:01000000:3.0:1789136057.029692:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789136057.029881:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.029904:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.029915:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136057.029938:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136057.029977:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.030020:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058ede480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.030167:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352320 00000100:00100000:2.0:1789136057.030174:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352320 00000100:00100000:2.0:1789136057.030223:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136057.030231:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+6:14815:x1876044723352320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136057.030245:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136057.030261:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072937000/0x38eb79866bf97056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9704f expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.030295:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072937000/0x38eb79866bf97056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9704f expref: 7 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.030307:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072937000/0x38eb79866bf97056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9704f expref: 7 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.030318:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937000, rc 0) 00000100:00100000:2.0:1789136057.030368:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+7:14815:x1876044723352320:12345-0@lo:101:mount.lustre.0 Request processed in 137us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.030375:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136057.030462:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136057.030475:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97056 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.030506:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97056 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136057.030523:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789136057.030541:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97056 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.030549:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4600/0x38eb79866bf9704f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97056 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136057.030557:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789136057.030561:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136057.030566:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ba073580000 10000000:01000000:0.0:1789136057.030568:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789136057.030572:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789136057.030574:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789136057.030590:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.030597:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.030614:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136057.030629:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136057.030657:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136057.030682:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.030992:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352448 00000100:00100000:2.0:1789136057.030997:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352448 00000100:00100000:2.0:1789136057.031031:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136057.031038:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+7:14815:x1876044723352448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136057.031046:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136057.031055:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072937e00/0x38eb79866bf97064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9705d expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.031069:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072937e00/0x38eb79866bf97064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9705d expref: 8 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.031077:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072937e00/0x38eb79866bf97064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9705d expref: 8 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.031084:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937e00, rc 0) 00000100:00100000:2.0:1789136057.031123:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+8:14815:x1876044723352448:12345-0@lo:101:mount.lustre.0 Request processed in 85us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.031130:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136057.031213:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136057.031226:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97064 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.031233:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97064 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.031289:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136057.031317:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.031343:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.031619:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352576 00000100:00100000:2.0:1789136057.031623:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352576 00000100:00100000:2.0:1789136057.031642:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136057.031647:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+8:14815:x1876044723352576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136057.032261:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+9:14815:x1876044723352576:12345-0@lo:501:mount.lustre.0 Request processed in 611us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.032269:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136057.035846:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136057.035923:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136057.036004:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.036107:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.044209:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352704 00000100:00100000:0.0:1789136057.044227:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352704 00000100:00100000:0.0:1789136057.044304:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136057.044315:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+9:14815:x1876044723352704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136057.045233:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+9:14815:x1876044723352704:12345-0@lo:503:mount.lustre.0 Request processed in 916us (9225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136057.045242:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136057.045475:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723352704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136057.046236:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14851:1876044723352832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136057.046293:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136057.046334:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136057.046391:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723352832 00000100:00100000:3.0:1789136057.046398:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723352832 00000100:00100000:3.0:1789136057.046453:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136057.046462:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+9:14851:x1876044723352832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136057.046956:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+9:14851:x1876044723352832:12345-0@lo:502:llog_process_th.0 Request processed in 494us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.046965:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136057.047110:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14851:1876044723352832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789136057.047135:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136057.047147:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.047149:0:14851:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789136057.047156:0:14851:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789136057.047158:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136057.047175:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8b9f465c4ed8) 00000020:00000080:2.0:1789136057.047193:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789136057.047198:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789136057.047277:0:14851:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789136057.047285:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf97072 00000020:00000080:2.0:1789136057.047911:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789136057.047918:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136057.047922:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.047924:0:14851:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789136057.047927:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136057.047932:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.047933:0:14851:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789136057.047937:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136057.047952:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8b9f465c3490) 00000020:00000080:2.0:1789136057.047964:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789136057.047968:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789136057.047970:0:14851:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789136057.047973:0:14851:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789136057.047980:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136057.048020:0:14851:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba073580000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789136057.048030:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8b9f465c0000) 00000020:00000080:2.0:1789136057.048037:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789136057.048079:0:14851:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789136057.048084:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf97087 00000020:00000080:2.0:1789136057.048172:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789136057.048178:0:14851:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789136057.048183:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x38eb79866bf9708e 00080000:01000000:2.0:1789136057.048189:0:14851:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789136057.048193:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf97095 00010000:00010000:0.0:1789136057.204929:0:14851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789136057.210126:0:14851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1789136057.210435:0:14851:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789136057.213221:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ba04918b490) 00000020:00000080:0.0:1789136057.213242:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789136057.215935:0:14851:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789136057.215951:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf970a3 00000020:00000080:0.0:1789136057.222053:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789136057.236148:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x38eb79866bf970aa 00000020:00000080:0.0:1789136057.238589:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789136057.238613:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136057.238621:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136057.238623:0:14851:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789136057.238629:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136057.238636:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136057.238638:0:14851:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789136057.238643:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789136057.238689:0:14851:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789136057.238741:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136057.238746:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136057.238747:0:14851:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789136057.238750:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789136057.238752:0:14851:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789136057.238754:0:14851:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136057.238768:0:14851:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136057.238770:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789136057.238773:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136057.238775:0:14851:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789136057.238778:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789136057.238782:0:14851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789136057.238785:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136057.238787:0:14851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789136057.238790:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789136057.238795:0:14851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.141@tcp to nid 0x20000c0a8cc8d (192.168.204.141@tcp) 00000020:01000000:0.0:1789136057.238823:0:14851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789136057.238826:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789136057.238842:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ba049188000) 00000020:00000080:0.0:1789136057.238860:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789136057.238865:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789136057.238932:0:14851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789136057.238938:0:14851:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789136057.238945:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf970b8 00010000:00080000:0.0:1789136057.238978:0:14851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b9f46d45800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:0.0:1789136057.239192:0:14851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789136057.245101:0:14851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136057.245167:0:14851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789136057.247564:0:14851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136057.247659:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789136057.247848:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789136057.248775:0:14855:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789136057.248780:0:14855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789136057.252905:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136057.252923:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789136057.252966:0:14851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789136057.252986:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf970bf 00000100:00080000:3.0:1789136057.252996:0:14851:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136057.253002:0:14851:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b9f46d45800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136057.253040:0:14851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4d2c0 x1876044723352960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136057.253068:0:14851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789136057.253181:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723353088:0@lo:400:kworker.0 00000020:01000000:3.0:1789136057.253195:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.253198:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.253200:0:14851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789136057.253202:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136057.253205:0:14851:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789136057.253207:0:14851:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136057.253208:0:14851:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136057.253209:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136057.253212:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.253213:0:14851:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136057.253215:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136057.253219:0:14851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789136057.253222:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.253223:0:14851:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789136057.253226:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136057.253229:0:14851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.141@tcp to nid 0x20000c0a8cc8d (192.168.204.141@tcp) 00000100:00100000:0.0:1789136057.253247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789136057.253248:0:14851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789136057.253251:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136057.253261:0:14851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ba074364ed8) 00000020:00000080:3.0:1789136057.253272:0:14851:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789136057.253276:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789136057.253323:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353088 00000100:00100000:0.0:1789136057.253330:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353088 00000004:00080000:3.0:1789136057.253344:0:14851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789136057.253349:0:14851:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789136057.253354:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x38eb79866bf970cd 00000100:00100000:0.0:1789136057.253365:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136057.253373:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+9:3311:x1876044723353088:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789136057.253382:0:14851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba043462000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:3.0:1789136057.253571:0:14851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789136057.253631:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+9:3311:x1876044723353088:12345-0@lo:400:kworker.0 Request processed in 256us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136057.253639:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136057.253682:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723353088:0@lo:400:kworker.0 00000040:01000000:3.0:1789136057.253794:0:14851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789136057.253816:0:14851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789136057.254358:0:14851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136057.254427:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789136057.254506:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789136057.254862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723352960:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789136057.254903:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044723352960 offset 0 length 520: 4 00000040:00080000:3.0:1789136057.261904:0:14857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789136057.261912:0:14857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789136057.264170:0:14851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789136057.264185:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789136057.264227:0:14851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789136057.264258:0:14851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf970d4 00000100:00080000:2.0:1789136057.264269:0:14851:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136057.264275:0:14851:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba043462000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789136057.264326:0:14851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072eec780 x1876044723353216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136057.264352:0:14851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789136057.264415:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136057.264419:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.264433:0:14851:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789136057.264438:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136057.264443:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.264444:0:14851:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136057.264447:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136057.264449:0:14851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136057.264451:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136057.264453:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.264454:0:14851:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136057.264456:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136057.264458:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136057.264460:0:14851:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136057.264463:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789136057.264524:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723353216:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789136057.264586:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044723353216 offset 0 length 520: 4 00000100:00100000:2.0:1789136057.264936:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14851:1876044723353344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136057.265058:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.265089:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.265184:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353344 00000100:00100000:2.0:1789136057.265191:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353344 00000100:00100000:2.0:1789136057.265255:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136057.265264:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+9:14851:x1876044723353344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136057.265827:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+9:14851:x1876044723353344:12345-0@lo:502:llog_process_th.0 Request processed in 562us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.265836:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136057.265953:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14851:1876044723353344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136057.265982:0:14851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.265988:0:14851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.265989:0:14851:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136057.265993:0:14851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789136057.266164:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789136057.266191:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789136057.266215:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97064 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.266226:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba086377000/0x38eb79866bf9705d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97064 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136057.266234:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba073580000 from 1 10000000:01000000:1.0:1789136057.266236:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136057.266275:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.266284:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.266293:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.266309:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136057.266354:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.266389:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.266639:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353472 00000100:00100000:2.0:1789136057.266644:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353472 00000100:00100000:2.0:1789136057.266677:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136057.266685:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+9:14815:x1876044723353472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136057.266696:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136057.266738:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf970db expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.266760:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf970db expref: 10 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.266778:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf970db expref: 10 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.266787:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936c00, rc 0) 00000100:00100000:2.0:1789136057.266823:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+10:14815:x1876044723353472:12345-0@lo:101:mount.lustre.0 Request processed in 138us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.266829:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136057.267144:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136057.267157:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.267167:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.267759:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353600:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789136057.267810:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.267844:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.268066:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353600 00000100:00100000:2.0:1789136057.268071:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353600 00000100:00100000:2.0:1789136057.268110:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136057.268118:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+10:14815:x1876044723353600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789136057.268134:0:14826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789136057.268139:0:14826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789136057.268213:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+10:14815:x1876044723353600:12345-0@lo:256:mount.lustre.0 Request processed in 95us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.268220:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136057.268433:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353600:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789136057.269149:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136057.269171:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.269181:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136057.269190:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba073580000 from 1 10000000:01000000:1.0:1789136057.269193:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136057.269224:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.269232:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.269241:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.269259:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136057.269298:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136057.269510:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353728 00000100:00100000:2.0:1789136057.269516:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353728 00000100:00100000:2.0:1789136057.269554:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136057.269562:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+10:14815:x1876044723353728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136057.269573:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136057.269587:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf970e9 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.269619:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.269646:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.269654:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937600, rc 0) 00000100:00100000:2.0:1789136057.269688:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723353728:12345-0@lo:101:mount.lustre.0 Request processed in 127us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.269694:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136057.271651:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.271683:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136057.271744:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136057.271756:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136057.272001:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136057.272056:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136057.272093:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0580f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.272419:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353856 00000100:00100000:2.0:1789136057.272426:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353856 00000100:00100000:2.0:1789136057.272472:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136057.272482:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723353856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136057.273268:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723353856:12345-0@lo:501:mount.lustre.0 Request processed in 786us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.273278:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136057.277288:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136057.277393:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136057.277471:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136057.277728:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723353984 00000100:00100000:2.0:1789136057.277736:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723353984 00000100:00100000:2.0:1789136057.277785:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136057.277794:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723353984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136057.277896:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0580f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136057.277995:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723353984:12345-0@lo:503:mount.lustre.0 Request processed in 202us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136057.278004:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136057.278161:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723353984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136057.282923:0:14859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14859:1876044723354112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136057.283017:0:14859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136057.283068:0:14859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.283133:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354112 00000100:00100000:0.0:1789136057.283141:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354112 00000100:00100000:0.0:1789136057.283189:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136057.283197:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+11:14859:x1876044723354112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136057.283642:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+11:14859:x1876044723354112:12345-0@lo:502:llog_process_th.0 Request processed in 443us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136057.283650:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789136057.283985:0:14859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14859:1876044723354112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136057.284013:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136057.284023:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284026:0:14859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789136057.284032:0:14859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba073580000 00000020:00000080:3.0:1789136057.284035:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136057.284043:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.284045:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284047:0:14859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789136057.284049:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136057.284051:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284052:0:14859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789136057.284055:0:14859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba073580000 00000020:00000080:3.0:1789136057.284057:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136057.284118:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.284121:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284122:0:14859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136057.284124:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136057.284126:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284127:0:14859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136057.284131:0:14859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba073580000 00000020:00000080:3.0:1789136057.284139:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136057.284156:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.284158:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284159:0:14859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136057.284162:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136057.284164:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284165:0:14859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136057.284168:0:14859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba073580000 00000020:00000080:3.0:1789136057.284170:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789136057.284203:0:14859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14859:1876044723354240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136057.284238:0:14859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.284282:0:14859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0491f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1789136057.284414:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354240 00000100:00100000:1.0:1789136057.284420:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354240 00000100:00100000:1.0:1789136057.284450:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136057.284458:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+11:14859:x1876044723354240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136057.284648:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+11:14859:x1876044723354240:12345-0@lo:502:llog_process_th.0 Request processed in 190us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136057.284662:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136057.284690:0:14859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14859:1876044723354240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136057.284743:0:14859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136057.284748:0:14859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136057.284750:0:14859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789136057.284753:0:14859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789136057.284881:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789136057.284898:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136057.284912:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.284922:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136057.284962:0:14815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789136057.284965:0:14815:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba073580000 10000000:01000000:1.0:1789136057.284968:0:14815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba073580000 10000000:01000000:1.0:1789136057.284972:0:14815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136057.284977:0:14815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba073580000 from 1 10000000:01000000:1.0:1789136057.284980:0:14815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789136057.285005:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.285012:0:14815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.285020:0:14815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.285034:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136057.285062:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.285092:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136057.286405:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354368 00000100:00100000:0.0:1789136057.286413:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354368 00000100:00100000:3.0:1789136057.286994:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136057.287007:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723354368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136057.287021:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136057.287040:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf970fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf970f7 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.287067:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf970fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf970f7 expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.287078:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5000/0x38eb79866bf970fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf970f7 expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.287098:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5000, rc 0) 00000100:00100000:3.0:1789136057.287160:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723354368:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.287167:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136057.296448:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136057.296479:0:14815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970fe expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.296497:0:14815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf970fe expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.296575:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136057.296656:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.296693:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354496 00000100:00100000:3.0:1789136057.296718:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354496 00000100:00100000:1.0:1789136057.297031:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136057.299618:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136057.299643:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723354496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136057.301135:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723354496:12345-0@lo:501:mount.lustre.0 Request processed in 1497us (4471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.302546:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136057.304888:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136057.304960:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136057.305039:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.305090:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136057.305416:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354624 00000100:00100000:3.0:1789136057.305423:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354624 00000100:00100000:3.0:1789136057.305469:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136057.305480:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723354624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136057.305718:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723354624:12345-0@lo:503:mount.lustre.0 Request processed in 220us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.305727:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136057.305917:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723354624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136057.308581:0:14863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14863:1876044723354752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136057.308671:0:14863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.308838:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354752 00000100:00100000:3.0:1789136057.308846:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354752 00000100:00100000:3.0:1789136057.308891:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136057.308899:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:14863:x1876044723354752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136057.309136:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:14863:x1876044723354752:12345-0@lo:502:llog_process_th.0 Request processed in 237us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.309146:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136057.309610:0:14863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789136057.309634:0:14863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14863:1876044723354752:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789136057.309691:0:14863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789136057.310806:0:14863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ba0503b0000) 00000020:00000080:1.0:1789136057.310829:0:14863:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789136057.310956:0:14863:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba073580000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789136057.310961:0:14863:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba073580000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789136057.310964:0:14863:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba073580000 4 00010000:00080000:1.0:1789136057.310993:0:14863:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba045f33000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.141@tcp at head 00010000:00010000:1.0:1789136057.331049:0:14863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789136057.331253:0:14863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789136057.331298:0:14863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136057.331313:0:14863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x38eb79866bf9710c 00000100:00080000:1.0:1789136057.331323:0:14863:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136057.331330:0:14863:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ba045f33000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:1.0:1789136057.331363:0:14863:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba073c8cf00 x1876044723354880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136057.331390:0:14863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789136057.333880:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723354880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136057.333967:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136057.334130:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723354880 00000100:00100000:2.0:1789136057.334143:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723354880 00000100:00100000:2.0:1789136057.334179:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136057.334187:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723354880:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136057.334249:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1876044723354880:12345-0@lo:38:llog_process_th.0 Request processed in 62us (282us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789136057.334257:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136057.334293:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136057.334302:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba045f33000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136057.334306:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789136057.334370:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723354880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136057.339031:0:14863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14863:1876044723355008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136057.339118:0:14863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136057.339158:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355008 00000100:00100000:1.0:1789136057.339165:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355008 00000100:00100000:1.0:1789136057.339215:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136057.339225:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14863:x1876044723355008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136057.342875:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14863:x1876044723355008:12345-0@lo:502:llog_process_th.0 Request processed in 3639us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136057.342891:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136057.342980:0:14863:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07261ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136057.343010:0:14863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2dc02be1-e923-45bb-814e-7c82b120b447:14863:1876044723355008:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789136057.343051:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789136057.343389:0:14815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789136057.343412:0:14815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136057.343436:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970fe expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136057.343449:0:14815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6800/0x38eb79866bf970f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf970fe expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136057.343499:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136057.343502:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136057.343504:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136057.343505:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136057.343507:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136057.343508:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136057.343510:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136057.343512:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136057.343514:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136057.343516:0:14815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136057.343519:0:14815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789136057.343522:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136057.343523:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136057.343524:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136057.343531:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136057.343533:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136057.343534:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136057.343534:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136057.343536:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136057.343537:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136057.343538:0:14815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136057.343563:0:14815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136057.343581:0:14815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eed680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723355136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136057.343662:0:14815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.343691:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355136 00000100:00100000:3.0:1789136057.343712:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355136 00000100:00100000:3.0:1789136057.343756:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136057.343765:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14815:x1876044723355136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136057.343807:0:14827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789136057.343820:0:14827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789136057.345429:0:14815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0604ba540 going to sleep for 11 seconds 20000000:01000000:0.0:1789136057.409040:0:14827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789136057.409088:0:14827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789136057.410981:0:14849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789136057.410989:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789136057.411011:0:14849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.411029:0:14849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf970db expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.411038:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.411082:0:14849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.411101:0:14849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 12 pid: 14827 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136057.411116:0:14849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723355264:0@lo:104: 00000100:00100000:3.0:1789136057.411187:0:14849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.411240:0:14849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0491f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136057.411439:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355264 00000100:00100000:1.0:1789136057.411447:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355264 00000100:00100000:1.0:1789136057.411494:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136057.411503:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723355264:12345-0@lo:104: 00010000:00010000:1.0:1789136057.411517:0:14816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136057.411581:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136057.411587:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723355264:12345-0@lo:104: Request processed in 86us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136057.411606:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789136057.412148:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136057.412156:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412173:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136057.412177:0:14822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412188:0:14822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136057.412196:0:14822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136057.412201:0:14822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789136057.412244:0:14822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412251:0:14822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136057.412281:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412288:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7c00/0x38eb79866bf970db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970e2 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412305:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136057.412306:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136057.412308:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136057.412317:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136057.412331:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723355392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136057.412386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136057.412441:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355392 00000100:00100000:3.0:1789136057.412445:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355392 00010000:00010000:3.0:1789136057.412472:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 13 pid: 14827 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136057.412494:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136057.412501:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+13:3311:x1876044723355392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136057.412512:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136057.412517:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 13 pid: 14827 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412528:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 13 pid: 14827 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412546:0:14818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412555:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789136057.412570:0:14818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001580809s 00010000:00010000:3.0:1789136057.412575:0:14818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412582:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412590:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412609:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412615:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136057.412624:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412633:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412642:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412652:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136057.412680:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+13:3311:x1876044723355392:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136057.412687:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136057.412758:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723355392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136057.412785:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba072936c00/0x38eb79866bf970e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf970db expref: 12 pid: 14827 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136057.412795:0:14849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723355264:0@lo:104: 00010000:00010000:3.0:1789136057.412807:0:14849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412817:0:14849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412824:0:14849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136057.412831:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a4400/0x38eb79866bf97113 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136057.415138:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+11:14815:x1876044723355136:12345-0@lo:253:mount.lustre.0 Request processed in 71362us (71465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136057.415153:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136057.415243:0:14815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eed680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:14815:1876044723355136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136057.415260:0:14815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789136057.415263:0:14815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136057.415265:0:14815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136057.415266:0:14815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136057.415267:0:14815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136057.415268:0:14815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136057.415269:0:14815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136057.415270:0:14815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136057.415272:0:14815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136057.415273:0:14815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136057.415275:0:14815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789136057.415289:0:14815:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789136057.419474:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789136057.419646:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789136057.420102:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789136057.420240:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789136057.420983:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789136057.421121:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789136057.423275:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136057.424632:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789136057.426506:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136057.426808:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789136057.427099:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136057.427254:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789136057.460273:0:14815:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789136057.460670:0:14815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789136057.461129:0:14874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789136057.461206:0:14874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136057.463243:0:14874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789136057.463317:0:14874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789136057.463321:0:14874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1789136057.465477:0:14873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789136057.465483:0:14873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789136057.465905:0:14815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789136057.466033:0:14815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789136057.466442:0:14815:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789136057.466449:0:14815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789136057.467200:0:14815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136057.469070:0:14815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789136057.469907:0:14815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789136057.469947:0:14815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789136057.472826:0:14815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789136057.478529:0:14815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789136057.497858:0:14815:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789136057.497897:0:14815:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb42301647988 00100000:10000000:2.0:1789136057.497906:0:14815:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789136057.499638:0:14815:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789136057.499653:0:14815:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789136057.499665:0:14815:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789136057.499736:0:14815:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789136057.804928:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136058.381364:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789136058.765479:0:14830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789136058.765487:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba073580000 from 6 10000000:01000000:1.0:1789136058.765492:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136058.765544:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.765557:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.765580:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136058.765607:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723355520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136058.765683:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136058.765820:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0448ce600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136058.771333:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355520 00000100:00100000:2.0:1789136058.771347:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355520 00000100:00100000:3.0:1789136058.773897:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136058.773911:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+11:14830:x1876044723355520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136058.773944:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136058.773961:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9711a expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.773990:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9711a expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.774000:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9711a expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136058.774010:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5c00, rc 0) 00000100:00100000:3.0:1789136058.774098:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723355520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (8415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136058.774105:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136058.774219:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723355520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136058.774237:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.774246:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136058.774320:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723355648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789136058.774362:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136058.775109:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0448ce600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136058.776717:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355648 00000100:00100000:2.0:1789136058.776746:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355648 00000100:00100000:2.0:1789136058.776800:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136058.776810:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723355648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136058.776836:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136058.776851:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136058.776854:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789136058.777458:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723355648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 647us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136058.777467:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136058.777955:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723355648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789136058.778016:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136058.778026:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136058.778037:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136058.829314:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136059.406133:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136059.852990:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136060.876895:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136061.900830:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789136062.278994:0:15116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789136062.669913:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136062.669919:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136062.669922:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136062.669925:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136062.669927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136062.669930:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136062.669933:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ba045f33000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136062.669944:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ba045f33000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:2.0:1789136062.669964:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072eec3c0 x1876044723355904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136062.669993:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723355904:0@lo:38:kworker.0 00000100:00100000:2.0:1789136062.670054:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136062.670316:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723355776:0@lo:400:kworker.0 00000100:00100000:0.0:1789136062.670349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136062.670393:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355776 00000100:00100000:0.0:1789136062.670399:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355776 00000100:00100000:0.0:1789136062.670433:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136062.670440:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:3313:x1876044723355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136062.670486:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:3313:x1876044723355776:12345-0@lo:400:kworker.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136062.670492:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136062.670548:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723355776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136062.671270:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723355904 00000100:00100000:1.0:1789136062.671277:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723355904 00000100:00100000:1.0:1789136062.671302:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136062.671307:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1876044723355904:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789136062.671333:0:14835:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1789136062.671368:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x38eb79866bf97128 00000004:00100000:1.0:1789136062.671382:0:14835:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136062.671538:0:14835:0:(import.c:65:import_set_state_nolock()) ffff8ba045f31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136062.671591:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eeda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876044723355904:12345-0@lo:38:kworker.0 Request processed in 282us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136062.671598:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789136062.672030:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba072eec3c0 x1876044723355904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136062.672046:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789136062.672054:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789136062.672059:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789136062.672061:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba045f33000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136062.672067:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876044723355904:0@lo:38:kworker.0 00010000:00010000:3.0:1789136062.925353:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136063.950240:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136064.974621:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789136065.498040:0:15267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc11ecb570 20000000:00000080:2.0:1789136065.498062:0:15267:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ba0541c1400 uarg=0000000000000000 20000000:01000000:2.0:1789136065.498098:0:15267:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789136065.498105:0:15267:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789136065.498110:0:15267:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789136065.499049:0:15268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789136065.499245:0:15267:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789136065.506181:0:15267:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789136065.506216:0:15267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.506241:0:15267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.506250:0:15267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.506297:0:15267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.506313:0:15267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136065.506349:0:15267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eeed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15267:1876044723356032:0@lo:104: 00000100:00100000:2.0:1789136065.506419:0:15267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136065.506483:0:15267:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136065.506581:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356032 00000100:00100000:3.0:1789136065.506590:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356032 00000100:00100000:3.0:1789136065.506650:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136065.506661:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:15267:x1876044723356032:12345-0@lo:104: 00010000:00010000:3.0:1789136065.506677:0:14817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506765:0:14817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136065.506771:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:15267:x1876044723356032:12345-0@lo:104: Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136065.506788:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789136065.506812:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136065.506819:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506827:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:3.0:1789136065.506831:0:14821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506840:0:14821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136065.506847:0:14821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136065.506854:0:14821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789136065.506884:0:14821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506891:0:14821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136065.506910:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506916:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0738a6e00/0x38eb79866bf970e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf970f0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.506930:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136065.506932:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136065.506934:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136065.506954:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2dc02be1-e923-45bb-814e-7c82b120b447:3314:1876044723356160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136065.506989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136065.507024:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356160 00000100:00100000:3.0:1789136065.507028:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356160 00010000:00010000:3.0:1789136065.507045:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 12 pid: 14827 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136065.507065:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136065.507072:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+12:3314:x1876044723356160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136065.507081:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136065.507086:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 12 pid: 14827 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507096:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 12 pid: 14827 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507111:0:14818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507119:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507132:0:14818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507138:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507145:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507151:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507163:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136065.507167:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507175:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507183:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.507193:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136065.507223:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+12:3314:x1876044723356160:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136065.507230:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136065.507268:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2dc02be1-e923-45bb-814e-7c82b120b447:3314:1876044723356160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136065.507386:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba072937600/0x38eb79866bf970f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf970e9 expref: 11 pid: 14827 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136065.507396:0:15267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eeed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15267:1876044723356032:0@lo:104: 00010000:00010000:2.0:1789136065.507413:0:15267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.507421:0:15267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.507427:0:15267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136065.507434:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba072936600/0x38eb79866bf9712f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136065.996830:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789136066.764832:0:14830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789136066.764840:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba073580000 from 13 10000000:01000000:3.0:1789136066.764846:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136066.764894:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136066.764906:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136066.764918:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136066.764943:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136066.765014:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136066.766598:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba041359840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136066.771951:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356288 00000100:00100000:0.0:1789136066.771970:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356288 00000100:00100000:1.0:1789136066.772110:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136066.772121:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+11:14830:x1876044723356288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136066.772140:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136066.772180:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97136 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136066.772212:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97136 expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136066.772222:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97136 expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136066.772233:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7c00, rc 0) 00000100:00100000:1.0:1789136066.772325:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723356288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (7311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136066.772332:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136066.772374:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136066.772391:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136066.772401:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136066.772721:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136066.772761:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136066.772790:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0504f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136066.772811:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356416 00000100:00100000:1.0:1789136066.772815:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356416 00000100:00100000:1.0:1789136066.772833:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136066.772840:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723356416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136066.773100:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723356416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136066.773114:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136066.773142:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136066.773468:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136066.773510:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136066.773526:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0504f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136066.773557:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356544 00000100:00100000:1.0:1789136066.773562:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356544 00000100:00100000:1.0:1789136066.773582:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136066.773588:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723356544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136066.773785:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:14830:x1876044723356544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136066.773793:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136066.774151:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723356544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136066.775362:0:15314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789136066.781568:0:14830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789136066.781604:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136066.781614:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136066.781627:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136067.021962:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136067.789843:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136057/real 1789136057] req@ffff8ba072eec780 x1876044723353216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136067.789876:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba072eec780 x1876044723353216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136067.789944:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136057/real 1789136057] req@ffff8ba072f4d2c0 x1876044723352960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136067.789959:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba072f4d2c0 x1876044723352960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136067.789981:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136067.789990:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136067.789994:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723353216:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789136067.790000:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136067.790004:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136067.790008:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723352960:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789136067.790135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136067.790141:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136067.790144:0:37:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136067.790149:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1789136067.790154:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136067.790169:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b9f46d45800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:0.0:1789136067.790179:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136067.790191:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.790252:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136067.790311:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723356672 00000100:00100000:0.0:1789136067.790318:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723356672 00000100:00100000:0.0:1789136067.790359:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136067.790368:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:3312:x1876044723356672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.790426:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+12:3312:x1876044723356672:12345-0@lo:400:kworker.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136067.790432:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136067.790474:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.790508:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c098000 x1876044723356800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136067.790522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136067.790525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136067.790527:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136067.790530:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1789136067.790532:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136067.790536:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba043462000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:0.0:1789136067.790544:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723356800:0@lo:8:kworker.0 00000400:00000100:0.0:1789136067.790568:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044723356800 offset 0 length 520: 4 00000100:00100000:0.0:1789136067.790596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba05c09b0c0 x1876044723356928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136067.790613:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723356928:0@lo:8:kworker.0 00000400:00000100:0.0:1789136067.790640:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044723356928 offset 0 length 520: 4 00000100:00100000:0.0:1789136067.790676:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723357056:0@lo:400:kworker.0 00000100:00100000:0.0:1789136067.790730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136067.791787:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357056 00000100:00100000:2.0:1789136067.791795:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357056 00000100:00100000:2.0:1789136067.791833:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136067.791842:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723357056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136067.791905:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723357056:12345-0@lo:400:kworker.0 Request processed in 64us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136067.791911:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789136067.798806:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba05c098780 x1876044723357056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136067.798826:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723357056:0@lo:400:kworker.0 00010000:00010000:3.0:1789136068.060692:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136069.069105:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136069.645407:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136070.092916:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136071.118388:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136071.296962:0:15517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136071.296967:0:15517:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789136071.297570:0:15517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba085f47800 00000020:01000004:3.0:1789136071.297589:0:15517:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136071.297601:0:15517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789136071.297615:0:15517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ba074361a48) 00000020:00000080:3.0:1789136071.297632:0:15517:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789136071.341034:0:15517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789136071.341381:0:15517:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789136071.342761:0:15517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789136071.343018:0:15517:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789136071.343298:0:15517:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789136071.343971:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789136071.344592:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789136071.344918:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789136071.346018:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 450: rc = 0 00100000:10000000:2.0:1789136071.346546:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 450: rc = 0 00100000:10000000:2.0:1789136071.346904:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 450: rc = 0 00100000:10000000:2.0:1789136071.348386:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 450: rc = 0 00100000:10000000:2.0:1789136071.349040:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 450: rc = 0 00100000:10000000:2.0:1789136071.349448:0:15517:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 450: rc = 0 00000020:00000080:2.0:1789136071.352113:0:15517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789136071.352125:0:15517:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789136071.352135:0:15517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x38eb79866bf9714b 00000020:01000004:2.0:1789136071.352145:0:15517:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789136071.352164:0:15517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789136071.352167:0:15517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789136071.352173:0:15517:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789136071.352177:0:15517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789136071.352205:0:15517:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ba054363490) 00000020:00000080:2.0:1789136071.352215:0:15517:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789136071.354101:0:15517:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136071.354267:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789136071.354274:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789136071.363287:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136071.363302:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789136071.366390:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789136071.366403:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789136071.369101:0:15517:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136071.369290:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136071.369295:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789136071.370459:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789136071.370467:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789136071.394681:0:15517:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136071.394986:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789136071.394993:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789136071.401948:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789136071.401969:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789136071.411615:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789136071.411638:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789136071.429720:0:15517:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136071.430013:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136071.430022:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789136071.437232:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789136071.437256:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789136071.524650:0:15517:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136071.524975:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136071.524982:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789136071.533772:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789136071.533784:0:15517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789136071.534881:0:15517:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789136071.534909:0:15517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789136071.534916:0:15517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789136071.563424:0:15517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136071.563899:0:15517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.141@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789136071.563905:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136071.563907:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136071.563908:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136071.563909:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136071.563910:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136071.563912:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136071.563914:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136071.563916:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136071.563917:0:15517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136071.563922:0:15517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789136071.563924:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136071.563925:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136071.563926:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136071.563928:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136071.563929:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136071.563930:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136071.563931:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136071.563932:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136071.563933:0:15517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136071.563958:0:15517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789136071.563980:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136071.564351:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.564444:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba04378d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.568620:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357184 00000100:00100000:0.0:1789136071.568638:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357184 00000100:00100000:0.0:1789136071.569232:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789136071.569246:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:15517:x1876044723357184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136071.571135:0:14826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789136071.571143:0:14826:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789136071.571148:0:14826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789136071.580270:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:15517:x1876044723357184:12345-0@lo:253:mount.lustre.0 Request processed in 11007us (15899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136071.580287:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136071.580457:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136071.580474:0:15517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789136071.580478:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136071.580480:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136071.580482:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136071.580483:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136071.580484:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136071.580486:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136071.580488:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136071.580490:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136071.580491:0:15517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136071.580511:0:15517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba085f47800 from lustre-OST0000 10000000:01000000:2.0:1789136071.580542:0:15517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789136071.580545:0:15517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789136071.580554:0:15517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ba074363490 local copy 00010000:00010000:2.0:1789136071.580566:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136071.580835:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.580873:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.580901:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba04378d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.581029:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357312 00000100:00100000:0.0:1789136071.581035:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357312 00000100:00100000:0.0:1789136071.581089:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136071.581098:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:15517:x1876044723357312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136071.581267:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+12:15517:x1876044723357312:12345-0@lo:501:mount.lustre.0 Request processed in 169us (393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136071.581275:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136071.581584:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357312:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789136071.581599:0:15517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789136071.581783:0:15517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789136071.581790:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.581799:0:15517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136071.581822:0:15517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba085f47800 10000000:01000000:2.0:1789136071.581834:0:15517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789136071.581839:0:15517:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ba074363490 10000000:01000000:2.0:1789136071.581842:0:15517:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789136071.581846:0:15517:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ba074363490 from 1 10000000:01000000:2.0:1789136071.581849:0:15517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789136071.581877:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.581885:0:15517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.581895:0:15517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136071.581911:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136071.581946:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.581967:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba04378d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.583643:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357440 00000100:00100000:0.0:1789136071.583654:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357440 00000100:00100000:0.0:1789136071.583771:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136071.583782:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+12:15517:x1876044723357440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136071.583799:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136071.583820:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba086376a00/0x38eb79866bf97160 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97159 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.583849:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba086376a00/0x38eb79866bf97160 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97159 expref: 13 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.583861:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba086376a00/0x38eb79866bf97160 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97159 expref: 13 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.583870:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba086376a00, rc 0) 00000100:00100000:0.0:1789136071.583949:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+13:15517:x1876044723357440:12345-0@lo:101:mount.lustre.0 Request processed in 169us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136071.583956:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136071.584160:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136071.584177:0:15517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97160 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.584187:0:15517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97160 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136071.584207:0:15517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789136071.584225:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97160 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.584246:0:15517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072936400/0x38eb79866bf97159 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97160 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136071.584255:0:15517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789136071.584261:0:15517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136071.584267:0:15517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789136071.584270:0:15517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789136071.584293:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.584301:0:15517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.584309:0:15517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136071.584339:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136071.584373:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.584408:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0628b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136071.584576:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357568 00000100:00100000:2.0:1789136071.584582:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357568 00000100:00100000:2.0:1789136071.584619:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136071.584627:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+13:15517:x1876044723357568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136071.584636:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136071.584647:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072937600/0x38eb79866bf9716e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97167 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.584663:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072937600/0x38eb79866bf9716e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97167 expref: 14 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.584671:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072937600/0x38eb79866bf9716e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97167 expref: 14 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.584691:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937600, rc 0) 00000100:00100000:2.0:1789136071.584752:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357568:12345-0@lo:101:mount.lustre.0 Request processed in 125us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136071.584759:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136071.585159:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136071.585173:0:15517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9716e expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.585182:0:15517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9716e expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136071.586251:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789136071.589896:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136071.590205:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789136071.590249:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789136071.590283:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789136071.590343:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789136071.590381:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789136071.590432:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789136071.590500:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789136071.590507:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789136071.594225:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136071.594318:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.594378:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0628b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136071.594556:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357696 00000100:00100000:2.0:1789136071.594564:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357696 00000100:00100000:2.0:1789136071.594625:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136071.594635:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.595376:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357696:12345-0@lo:501:mount.lustre.0 Request processed in 740us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136071.595386:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136071.595562:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136071.595608:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136071.595652:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.595745:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0628b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.600494:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357824 00000100:00100000:0.0:1789136071.600510:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357824 00000100:00100000:1.0:1789136071.600849:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136071.600861:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136071.601363:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357824:12345-0@lo:503:mount.lustre.0 Request processed in 502us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.601372:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136071.601502:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136071.602103:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136071.602180:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136071.602241:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.602281:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0628b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136071.602537:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723357952 00000100:00100000:1.0:1789136071.602551:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723357952 00000100:00100000:1.0:1789136071.602594:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136071.602602:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136071.602846:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723357952:12345-0@lo:502:mount.lustre.0 Request processed in 244us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.602853:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136071.603021:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723357952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136071.603309:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789136071.603372:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789136071.603404:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789136071.604554:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789136071.604632:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789136071.604667:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789136071.604789:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789136071.604828:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789136071.604864:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789136071.604910:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789136071.604948:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789136071.605011:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789136071.605355:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136071.605437:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.605561:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0628b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136071.605633:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358080 00000100:00100000:1.0:1789136071.605641:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358080 00000100:00100000:1.0:1789136071.605780:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136071.605790:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723358080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136071.605992:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723358080:12345-0@lo:502:mount.lustre.0 Request processed in 203us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.606000:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136071.606125:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136071.606205:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789136071.606215:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789136071.607222:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136071.607231:0:15531:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789136071.607237:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136071.607240:0:15531:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789136071.607245:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136071.607273:0:15531:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b9f455c8000) 00000020:00000080:3.0:1789136071.607295:0:15531:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789136071.607302:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789136071.607371:0:15531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba085f47800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789136071.607378:0:15531:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789136071.607385:0:15531:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x38eb79866bf9717c 00010000:00010000:3.0:1789136071.612286:0:15531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789136071.612854:0:15531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789136071.615029:0:15531:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789136071.619170:0:15531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789136071.619186:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.619194:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619197:0:15531:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789136071.619201:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136071.619204:0:15531:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789136071.619206:0:15531:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136071.619207:0:15531:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136071.619208:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136071.619211:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619212:0:15531:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136071.619215:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.619218:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619219:0:15531:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789136071.619222:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789136071.619224:0:15531:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789136071.619226:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.619235:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619236:0:15531:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789136071.619239:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.619241:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619242:0:15531:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789136071.619245:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789136071.619310:0:15531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.619314:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.619315:0:15531:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789136071.619319:0:15531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789136071.622079:0:15517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789136071.622134:0:15517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789136071.622164:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9716e expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.622194:0:15517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a4400/0x38eb79866bf97167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9716e expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136071.622204:0:15517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba085f47800 from 1 10000000:01000000:3.0:1789136071.622207:0:15517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136071.622250:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.622259:0:15517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.622270:0:15517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136071.622297:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136071.622385:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.622434:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044774e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.622722:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358208 00000100:00100000:0.0:1789136071.622729:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358208 00000100:00100000:0.0:1789136071.622777:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136071.622786:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+14:15517:x1876044723358208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136071.622802:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136071.622816:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97183 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.622841:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97183 expref: 15 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.622853:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97183 expref: 15 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.622870:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba086377200, rc 0) 00000100:00100000:0.0:1789136071.622917:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358208:12345-0@lo:101:mount.lustre.0 Request processed in 131us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136071.622924:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136071.623684:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136071.623719:0:15517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.623731:0:15517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136071.624315:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789136071.624953:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136071.625531:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789136071.625580:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789136071.625654:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789136071.625662:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789136071.625858:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136071.625929:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.627253:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044774e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136071.628218:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358336 00000100:00100000:2.0:1789136071.628229:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358336 00000100:00100000:2.0:1789136071.628394:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789136071.628405:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.628828:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358336:12345-0@lo:501:mount.lustre.0 Request processed in 297us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136071.628838:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789136071.628933:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136071.628984:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136071.629031:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.629311:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044774e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.629502:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358464 00000100:00100000:0.0:1789136071.629508:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358464 00000100:00100000:0.0:1789136071.629536:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136071.629543:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136071.629739:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358464:12345-0@lo:503:mount.lustre.0 Request processed in 195us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136071.629747:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789136071.631389:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136071.634859:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136071.634975:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136071.636137:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136071.636185:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba042faf900 going to sleep for 11 seconds 00000100:00100000:2.0:1789136071.637487:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358592 00000100:00100000:2.0:1789136071.637497:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358592 00000100:00100000:2.0:1789136071.637550:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789136071.637559:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136071.637855:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358592:12345-0@lo:502:mount.lustre.0 Request processed in 296us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136071.637864:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789136071.637951:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136071.640409:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789136071.641989:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789136071.642585:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789136071.642631:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789136071.642897:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789136071.642958:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789136071.642996:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789136071.643028:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789136071.643168:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789136071.643207:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789136071.643257:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:2.0:1789136071.643334:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eed680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136071.643422:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136071.643550:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358720 00000100:00100000:1.0:1789136071.643560:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358720 00000100:00100000:2.0:1789136071.643572:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136071.643614:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136071.643624:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136071.643926:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358720:12345-0@lo:502:mount.lustre.0 Request processed in 304us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.643936:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136071.644008:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eed680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136071.644118:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789136071.644129:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789136071.645610:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.645621:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645624:0:15535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789136071.645630:0:15535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba085f47800 00000020:00000080:1.0:1789136071.645633:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136071.645644:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.645647:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645648:0:15535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789136071.645651:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.645653:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645655:0:15535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789136071.645658:0:15535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba085f47800 00000020:00000080:1.0:1789136071.645660:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136071.645751:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.645755:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645766:0:15535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789136071.645770:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.645773:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645774:0:15535:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136071.645777:0:15535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba085f47800 00000020:00000080:1.0:1789136071.645780:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136071.645802:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.645805:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645806:0:15535:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136071.645809:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136071.645811:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645813:0:15535:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136071.645816:0:15535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba085f47800 00000020:00000080:1.0:1789136071.645818:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136071.645853:0:15535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136071.645856:0:15535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136071.645858:0:15535:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789136071.645861:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789136071.646419:0:15517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789136071.646948:0:15517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136071.646968:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.646982:0:15517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136071.647034:0:15517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789136071.647037:0:15517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba085f47800 10000000:01000000:2.0:1789136071.647040:0:15517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba085f47800 10000000:01000000:2.0:1789136071.647044:0:15517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136071.647052:0:15517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba085f47800 from 1 10000000:01000000:2.0:1789136071.647054:0:15517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789136071.647091:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.647107:0:15517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.647120:0:15517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136071.647147:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136071.647212:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.647256:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136071.648107:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358848 00000100:00100000:3.0:1789136071.648120:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358848 00000100:00100000:3.0:1789136071.648183:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136071.648193:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723358848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136071.648212:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136071.648228:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf97198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97191 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.648384:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf97198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97191 expref: 16 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.648403:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4e00/0x38eb79866bf97198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97191 expref: 16 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.648412:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4e00, rc 0) 00000100:00100000:3.0:1789136071.648472:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723358848:12345-0@lo:101:mount.lustre.0 Request processed in 279us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.648479:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789136071.648607:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136071.648626:0:15517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97198 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.648636:0:15517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97198 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136071.649875:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789136071.651341:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136071.651662:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789136071.651727:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789136071.651763:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789136071.651807:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789136071.651845:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789136071.651889:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789136071.651941:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789136071.651975:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789136071.652020:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789136071.652057:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789136071.652105:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789136071.652152:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789136071.652186:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789136071.652217:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789136071.652264:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789136071.652299:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789136071.652345:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789136071.652392:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789136071.652428:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789136071.652461:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789136071.652507:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789136071.652542:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789136071.652593:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789136071.652644:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789136071.652679:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789136071.652735:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789136071.652796:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789136071.652835:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789136071.652911:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789136071.657644:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789136071.658243:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.658415:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.658468:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723358976 00000100:00100000:2.0:1789136071.658475:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723358976 00000100:00100000:2.0:1789136071.658527:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136071.658538:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723358976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.659414:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723358976:12345-0@lo:501:mount.lustre.0 Request processed in 873us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136071.659425:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136071.659483:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789136071.659513:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723358976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136071.659557:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136071.659602:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.659632:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136071.660003:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359104 00000100:00100000:1.0:1789136071.660010:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359104 00000100:00100000:1.0:1789136071.660049:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136071.660058:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136071.660525:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359104:12345-0@lo:503:mount.lustre.0 Request processed in 466us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.660534:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789136071.660615:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136071.664722:0:15517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136071.664817:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136071.664919:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.664972:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136071.664998:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359232 00000100:00100000:3.0:1789136071.665006:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359232 00000100:00100000:3.0:1789136071.665059:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789136071.665071:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136071.665363:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359232:12345-0@lo:502:mount.lustre.0 Request processed in 294us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.665371:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136071.667792:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136071.670064:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789136071.670148:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789136071.670185:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789136071.670234:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789136071.670373:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789136071.670425:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789136071.670480:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789136071.670514:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789136071.670564:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789136071.670598:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789136071.670627:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789136071.670676:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789136071.670732:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789136071.670769:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789136071.671090:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789136071.671133:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789136071.671167:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789136071.671219:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789136071.671266:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789136071.671398:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789136071.671448:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789136071.671485:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789136071.671535:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789136071.671585:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789136071.671622:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789136071.671656:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789136071.671730:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789136071.671770:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789136071.671928:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789136071.671985:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789136071.672022:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789136071.672054:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789136071.672087:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789136071.672136:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789136071.672174:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789136071.672224:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789136071.672259:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789136071.672470:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789136071.672541:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789136071.672579:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789136071.672632:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136071.672741:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.672791:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136071.673038:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359360 00000100:00100000:1.0:1789136071.673047:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359360 00000100:00100000:1.0:1789136071.673119:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789136071.673130:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136071.673670:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359360:12345-0@lo:502:mount.lustre.0 Request processed in 539us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136071.673686:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136071.673689:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136071.674048:0:15517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789136071.674060:0:15517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789136071.677420:0:15540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789136071.677438:0:15540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ba0503b4ed8) 00000020:00000080:1.0:1789136071.677461:0:15540:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789136071.677555:0:15540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba085f47800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136071.677560:0:15540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba085f47800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136071.677563:0:15540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba085f47800 3 00010000:00080000:1.0:1789136071.677610:0:15540:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba071cf2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.141@tcp at head 00010000:00010000:1.0:1789136071.683643:0:15540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789136071.687200:0:15540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789136071.687244:0:15540:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136071.687266:0:15540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x38eb79866bf971a6 00000100:00080000:1.0:1789136071.687278:0:15540:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136071.687286:0:15540:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ba071cf2000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:1.0:1789136071.687338:0:15540:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba073c8d2c0 x1876044723359488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136071.687368:0:15540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136071.687476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136071.687483:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136071.687487:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136071.687491:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789136071.687601:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789136071.687692:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723359616:0@lo:400:kworker.0 00000100:00100000:3.0:1789136071.687780:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136071.687831:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723359488:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136071.687869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789136071.687918:0:15517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789136071.687951:0:15517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789136071.687979:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97198 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.687991:0:15517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072936600/0x38eb79866bf97191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97198 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789136071.688041:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789136071.688044:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136071.688045:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136071.688047:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136071.688048:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136071.688049:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136071.688055:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136071.688058:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136071.688059:0:15517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136071.688063:0:15517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789136071.688065:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136071.688066:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136071.688067:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136071.688068:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136071.688069:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136071.688070:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136071.688071:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136071.688071:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136071.688072:0:15517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136071.688087:0:15517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789136071.688099:0:15517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136071.688135:0:15517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136071.688151:0:15517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0504f3840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136071.688169:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359744 00000100:00100000:0.0:1789136071.688175:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359744 00000100:00100000:0.0:1789136071.688212:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789136071.688221:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:15517:x1876044723359744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136071.688259:0:14827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789136071.688273:0:14827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789136071.688414:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359616 00000100:00100000:3.0:1789136071.688418:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359616 00000100:00100000:3.0:1789136071.688463:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359488 00000100:00100000:3.0:1789136071.688465:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359488 00000100:00100000:3.0:1789136071.688480:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136071.688497:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136071.688555:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723359616:12345-0@lo:400:kworker.0 Request processed in 62us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.688565:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136071.688584:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136071.688589:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1876044723359488:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789136071.688611:0:14834:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:3.0:1789136071.688649:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x38eb79866bf971ad 00000004:00100000:3.0:1789136071.688668:0:14834:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136071.688720:0:14834:0:(import.c:65:import_set_state_nolock()) ffff8ba058e63000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136071.688765:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876044723359488:12345-0@lo:38:llog_process_th.0 Request processed in 174us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.688772:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789136071.688812:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba072f4cf00 x1876044723359616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136071.688827:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723359616:0@lo:400:kworker.0 00010000:00080000:0.0:1789136071.690291:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ba073c8d2c0 x1876044723359488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136071.690305:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136071.690316:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789136071.690337:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789136071.690343:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789136071.690347:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba071cf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789136071.690354:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1876044723359488:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789136071.723672:0:14827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789136071.723694:0:14827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789136071.723784:0:14849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136071.723789:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136071.723883:0:14849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.723913:0:14849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9711a expref: 16 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.723923:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.723967:0:14849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 16 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.723982:0:14849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 16 pid: 14826 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136071.723998:0:14849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723359872:0@lo:104: 00000100:00100000:2.0:1789136071.724067:0:14849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136071.724116:0:14849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136071.724616:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723359872 00000100:00100000:3.0:1789136071.724624:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723359872 00000100:00100000:3.0:1789136071.724682:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136071.724693:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723359872:12345-0@lo:104: 00010000:00010000:3.0:1789136071.724750:0:14817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136071.725301:0:14817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136071.725319:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723359872:12345-0@lo:104: Request processed in 627us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.725337:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789136071.725355:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136071.725364:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.725375:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:0.0:1789136071.725379:0:14822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.725389:0:14822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136071.725397:0:14822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136071.725403:0:14822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789136071.725421:0:14849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723359872:0@lo:104: 00010000:00010000:0.0:1789136071.725445:0:14822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.725453:0:14822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136071.725472:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.725479:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7400/0x38eb79866bf9711a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf97121 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.725494:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136071.725496:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136071.725498:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136071.725601:0:14849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136071.726642:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136071.726667:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723360000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136071.726767:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136071.726898:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360000 00000100:00100000:0.0:1789136071.726906:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360000 00010000:00010000:0.0:1789136071.726952:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 17 pid: 14826 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136071.726992:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136071.727001:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dc02be1-e923-45bb-814e-7c82b120b447+17:3313:x1876044723360000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136071.727012:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136071.727017:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 17 pid: 14826 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727029:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 17 pid: 14826 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727048:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba07c1a5c00/0x38eb79866bf97121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf9711a expref: 17 pid: 14826 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727063:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727072:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789136071.727087:0:14820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003298807s 00010000:00010000:0.0:1789136071.727092:0:14820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727098:0:14820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727105:0:14820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727112:0:14820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727123:0:14820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136071.727128:0:14820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727137:0:14820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727161:0:14820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136071.727173:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136071.727226:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dc02be1-e923-45bb-814e-7c82b120b447+16:3313:x1876044723360000:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136071.727233:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789136071.727302:0:14849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136071.727319:0:14849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136071.727335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723360000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136071.727338:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba072936e00/0x38eb79866bf971b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136071.734775:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+15:15517:x1876044723359744:12345-0@lo:253:mount.lustre.0 Request processed in 46541us (46625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136071.734791:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789136071.734914:0:15517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:15517:1876044723359744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789136071.734931:0:15517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789136071.734935:0:15517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789136071.734937:0:15517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136071.734938:0:15517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136071.734939:0:15517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136071.734940:0:15517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136071.734942:0:15517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136071.734943:0:15517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136071.734946:0:15517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136071.734947:0:15517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789136071.734966:0:15517:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789136071.740201:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789136071.740382:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789136071.741659:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789136071.742375:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789136071.742685:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789136071.743176:0:15517:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789136071.744177:0:15517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789136071.799957:0:15517:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789136071.799967:0:15517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789136071.800000:0:15517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789136071.800056:0:15517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789136071.800084:0:15517:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789136071.800113:0:15517:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789136072.140931:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789136073.101207:0:14830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136073.101216:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba073580000 from 7 10000000:01000000:3.0:1789136073.101221:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136073.101274:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136073.101286:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136073.101311:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136073.101340:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723360128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136073.101413:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136073.101538:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136073.101587:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360128 00000100:00100000:1.0:1789136073.101597:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360128 00000100:00100000:1.0:1789136073.101666:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789136073.101676:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+15:14830:x1876044723360128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136073.101691:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136073.101734:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf971bb expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136073.101757:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf971bb expref: 16 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136073.101768:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf971bb expref: 16 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136073.101776:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7e00, rc 0) 00000100:00100000:1.0:1789136073.101814:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:14830:x1876044723360128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136073.101820:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136073.102009:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723360128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136073.102100:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136073.102111:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136073.102181:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723360256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136073.102212:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136073.102277:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c1b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789136073.102375:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360256 00000100:00100000:0.0:1789136073.102380:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360256 00000100:00100000:0.0:1789136073.102516:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136073.102525:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:14830:x1876044723360256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136073.102542:0:14827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136073.102561:0:14827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136073.102564:0:14827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789136073.102669:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:14830:x1876044723360256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136073.102677:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136073.102746:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723360256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136073.102807:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136073.102816:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136073.102825:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136073.171410:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136074.189189:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136075.213923:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136076.242193:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136077.010117:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136077.010125:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136077.010128:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136077.010131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136077.010267:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723360512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.010341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136077.010398:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136077.010405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723360384:0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.010436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136077.010468:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723360640:0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.010530:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136077.010565:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360512 00000100:00100000:3.0:1789136077.010572:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360512 00000100:00100000:3.0:1789136077.010609:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360640 00000100:00100000:3.0:1789136077.010612:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360640 00000100:00100000:3.0:1789136077.010635:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136077.010643:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723360512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789136077.011561:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136077.012837:0:14835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789136077.012859:0:14835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:1.0:1789136077.013658:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4c3c0 x1876044723360512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136077.013680:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044723360512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.013951:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044723360512:12345-0@lo:400:kworker.0 Request processed in 3298us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136077.013966:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136077.014004:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136077.014018:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.014095:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723360640:12345-0@lo:400:kworker.0 Request processed in 82us (3564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136077.014101:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136077.014132:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360384 00000100:00100000:3.0:1789136077.014139:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360384 00000100:00100000:3.0:1789136077.014179:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136077.014187:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:3312:x1876044723360384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136077.014242:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:3312:x1876044723360384:12345-0@lo:400:kworker.0 Request processed in 55us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136077.014249:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136077.014406:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723360384:0@lo:400:kworker.0 00010000:00080000:1.0:1789136077.014574:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4f480 x1876044723360640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136077.014589:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723360640:0@lo:400:kworker.0 00010000:00010000:0.0:1789136077.261143:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136078.316851:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789136078.760115:0:15885:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789136079.314016:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136079.891214:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136080.334203:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136081.361597:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136082.133659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136082.133667:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136082.133680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136082.133683:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136082.133873:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136082.140648:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723360768:0@lo:400:kworker.0 00000100:00100000:1.0:1789136082.140758:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136082.140842:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723360896:0@lo:400:kworker.0 00000100:00100000:1.0:1789136082.140873:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136082.140952:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136082.140960:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723361024:0@lo:400:kworker.0 00000100:00100000:1.0:1789136082.140984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136082.141179:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360896 00000100:00100000:3.0:1789136082.141187:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360896 00000100:00100000:3.0:1789136082.141253:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361024 00000100:00100000:3.0:1789136082.141256:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361024 00000100:00100000:3.0:1789136082.141302:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136082.141312:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723360896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136082.141375:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723360896:12345-0@lo:400:kworker.0 Request processed in 64us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136082.141383:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136082.141402:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136082.141409:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723361024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136082.141433:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723361024:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136082.141440:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789136082.141457:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789136082.141488:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba073c8c780 x1876044723361024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136082.141501:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723361024:0@lo:400:kworker.0 00010000:00080000:3.0:1789136082.141512:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba073c8c000 x1876044723360896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136082.141520:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723360896:0@lo:400:kworker.0 00000100:00100000:0.0:1789136082.141740:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723360768 00000100:00100000:0.0:1789136082.141745:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723360768 00000100:00100000:0.0:1789136082.141780:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136082.141788:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:3313:x1876044723360768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136082.141828:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+16:3313:x1876044723360768:12345-0@lo:400:kworker.0 Request processed in 41us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136082.141835:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136082.141881:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723360768:0@lo:400:kworker.0 00010000:00010000:2.0:1789136082.380942:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136082.961184:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136067/real 1789136067] req@ffff8ba05c09b0c0 x1876044723356928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136082.961228:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba05c09b0c0 x1876044723356928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136082.961238:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136067/real 1789136067] req@ffff8ba05c098000 x1876044723356800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136082.961249:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ba05c098000 x1876044723356800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136082.961274:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136082.961304:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136082.961308:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723356928:0@lo:8:kworker.0 00000100:00080000:2.0:1789136082.961315:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136082.961320:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136082.961324:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723356800:0@lo:8:kworker.0 00000100:00080000:3.0:1789136082.961419:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136082.961425:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789136082.961430:0:38:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136082.961436:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1789136082.961442:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136082.961450:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b9f46d45800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136082.961505:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4d680 x1876044723361152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136082.961530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136082.961533:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136082.961535:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136082.961538:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 541 00000100:00080000:3.0:1789136082.961541:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136082.961545:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba043462000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136082.961556:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4f840 x1876044723361280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136082.962280:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723361152:0@lo:8:kworker.0 00000100:00100000:2.0:1789136082.962372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136082.962435:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723361280:0@lo:8:kworker.0 00000100:00100000:2.0:1789136082.962473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136082.962518:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361152 00000100:00100000:2.0:1789136082.962527:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361152 00000100:00100000:2.0:1789136082.962564:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361280 00000100:00100000:2.0:1789136082.962567:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361280 00000100:00100000:2.0:1789136082.962581:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136082.962589:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723361152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136082.962630:0:15520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1789136082.962685:0:15520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf971c9 00002000:00100000:2.0:1789136082.962724:0:15520:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ba0491c7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789136082.962729:0:15520:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789136082.962733:0:15520:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136082.965505:0:15520:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789136082.965556:0:15520:0:(import.c:65:import_set_state_nolock()) ffff8ba0491c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136082.965727:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876044723361152:12345-0@lo:8:kworker.0 Request processed in 3107us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136082.965742:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136082.965786:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136082.965794:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723361280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789136082.965817:0:15520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136082.965850:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723361280:12345-0@lo:8:kworker.0 Request processed in 55us (3376us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136082.965870:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789136082.966180:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4d680 x1876044723361152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136082.966195:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136082.966209:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789136082.966222:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789136082.966229:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789136082.966234:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b9f46d45800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789136082.966270:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789136082.966278:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723361152:0@lo:8:kworker.0 00000004:00080000:3.0:1789136082.966285:0:14855:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1789136082.966303:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:3.0:1789136082.966747:0:14855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 556841045426ns, next at 0ns, rc = 0 00000100:00080000:1.0:1789136082.966883:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136082.966889:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723361280:0@lo:8:kworker.0 00000004:00080000:2.0:1789136082.968872:0:14856:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789136082.968914:0:14856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14856:1876044723361536:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136082.969003:0:14856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136082.969050:0:14856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136082.969123:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723361408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136082.969153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136082.969208:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361536 00000100:00100000:2.0:1789136082.969218:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361536 00000100:00100000:2.0:1789136082.969284:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136082.969295:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14856:x1876044723361536:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789136082.974443:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361408 00000100:00100000:1.0:1789136082.974465:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361408 00000100:00100000:1.0:1789136082.974533:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136082.974557:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723361408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136082.974609:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789136082.974751:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723361408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (5595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136082.974759:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789136082.976170:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789136082.976969:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072eef480 x1876044723361408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136082.977004:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723361408:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789136082.996171:0:15518:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789136082.996187:0:15518:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789136082.996195:0:15518:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1789136083.017413:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.017429:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017448:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.017453:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.017460:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017477:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017489:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017507:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017535:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136083.017553:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.017559:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017567:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.017572:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017582:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017599:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017607:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf971d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.017627:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.017628:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.017630:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.025057:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.025302:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.025323:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.025328:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.025336:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.025569:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.025585:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.025593:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.025666:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136083.029337:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.029354:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.029369:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.029375:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.029388:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.029559:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.029571:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf971d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.029605:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.029607:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.029608:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.030877:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.030890:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.031614:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.031620:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.031628:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.031647:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.031659:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.031669:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.031749:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136083.033075:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136083.033092:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033115:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136083.033121:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033134:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033166:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033191:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf971de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033220:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.033222:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.033224:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.033413:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.033422:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.033435:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.033439:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.033444:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.033458:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.033466:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.033473:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.033499:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136083.033764:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136083.033772:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033781:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136083.033786:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033797:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033812:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033821:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd754ed4/0x38eb79866bf971e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.033852:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.033855:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.033858:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.036618:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.036633:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036654:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.036667:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.036675:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036692:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036728:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036736:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036767:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136083.036789:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.036796:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036805:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.036810:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036821:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036841:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036863:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf971ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.036891:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.036894:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.036898:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.038929:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.038941:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.038957:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.038962:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.038968:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.038981:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.038991:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.038999:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039020:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136083.039036:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.039049:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039057:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.039062:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039074:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039093:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039101:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028bf7066/0x38eb79866bf971f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039136:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.039138:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.039141:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.039694:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.039724:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039735:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.039739:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.039745:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039769:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039779:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039788:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.039808:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136083.040283:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.040290:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040298:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.040302:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.040306:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040315:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040323:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040342:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040363:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136083.040376:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136083.040381:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040388:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.040392:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040401:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040416:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040423:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d6f1eae/0x38eb79866bf971fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040441:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.040445:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040463:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.040465:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040472:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040483:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040491:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca34b14d/0x38eb79866bf97201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.040505:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.040507:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.040508:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.040758:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.043589:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.043604:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.043624:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.043629:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.043635:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.043651:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.043672:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.043680:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.043741:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136083.044689:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.044844:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.044862:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.044866:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.044874:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.044891:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.045009:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.045018:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.045085:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136083.045451:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136083.045463:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045474:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136083.045481:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045492:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045516:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045525:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b4fdcf8/0x38eb79866bf97208 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045550:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136083.045554:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045561:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136083.045565:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045573:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045598:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045606:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c38f4bd7/0x38eb79866bf9720f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.045642:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.045645:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.045647:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.045757:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.046392:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.046402:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.046415:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.046420:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.046567:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.046584:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789136083.046589:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789136083.046595:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.046606:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.046669:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136083.049655:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.049669:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.049688:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.049751:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.049759:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.049777:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.049788:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.049795:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.049811:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136083.050456:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136083.050474:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.050490:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.050514:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.050522:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.050535:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.050570:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.050580:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c180c82/0x38eb79866bf97216 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.050624:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.050627:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.050631:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.050715:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.050719:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.050721:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.051071:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.051082:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.051086:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.051095:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.051136:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.051143:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c76d4dde/0x38eb79866bf9721d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.051161:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.051163:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.051165:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.052432:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.052447:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.052468:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.052473:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.052480:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.052507:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.052517:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.052536:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.052561:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136083.053833:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.053843:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.053858:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.053862:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.053868:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.053881:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.053889:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.053896:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.053923:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789136083.054567:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.054575:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.054594:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.054599:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.054606:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.054619:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.054630:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.054638:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.055197:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789136083.055330:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789136083.055347:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055365:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.055371:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055387:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055419:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055428:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f7bc88/0x38eb79866bf97224 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055482:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136083.055487:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055494:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.055498:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055507:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055518:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055524:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000667fc3fb/0x38eb79866bf9722b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055541:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.055546:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055552:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0fa00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.055556:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055575:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055587:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055594:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e022051d/0x38eb79866bf97232 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.055616:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.055619:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.055623:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.055635:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.055971:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.055980:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.055993:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.055997:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.056002:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056015:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056037:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056044:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056063:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136083.056318:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.056327:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.056337:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0f600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.056341:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.056351:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.056362:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.056366:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.056385:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2347663/0x38eb79866bf97239 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.056411:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.056416:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.056418:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.056931:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.056940:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056951:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.056954:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.056958:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056970:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056978:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.056986:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.057014:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136083.057895:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.057908:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.057920:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.057925:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.057935:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.057956:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.057964:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051b80f8/0x38eb79866bf97240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.058003:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.058005:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.058007:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.059453:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.059472:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.059507:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.059512:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.059520:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.059540:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.059552:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.059561:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.059592:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136083.060298:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136083.060307:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.060317:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0f200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136083.060322:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.060333:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.060353:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.060369:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007677bc30/0x38eb79866bf97247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.060392:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.060394:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136083.060396:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.060824:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.060832:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.060845:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.060857:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.060863:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.060876:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.060885:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.060943:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.060965:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136083.061765:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.061779:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.061795:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0ee00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.061801:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.061815:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.061840:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.061849:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3533ce/0x38eb79866bf9724e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.061875:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.061878:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.061880:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.063352:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.063368:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.063385:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.063389:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.063395:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.063409:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.063419:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.063454:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.064689:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136083.065088:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136083.065102:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.065127:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0f800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136083.065134:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.065147:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.065176:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.065184:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dff514ca/0x38eb79866bf97255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.065212:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136083.065215:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136083.065216:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136083.067537:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.067550:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.067568:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.067573:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.067580:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.067596:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.067606:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.067615:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.067647:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136083.069922:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789136083.069938:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.069966:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=556s v=(0 0) 00010000:00010000:2.0:1789136083.069971:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136083.069977:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.069993:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.070005:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.070013:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.070048:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136083.070574:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136083.070591:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070606:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0fc00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.070613:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070645:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070671:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070679:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5c14fc/0x38eb79866bf9725c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070738:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136083.070742:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070749:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0e000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136083.070753:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070760:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070770:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070777:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057e96eb3/0x38eb79866bf97263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136083.070807:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.070809:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136083.070811:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136083.071120:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136083.078118:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136083.078134:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078157:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=556s v=(0 0) 00010000:00010000:3.0:1789136083.078162:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136083.078170:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078188:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078201:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078210:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078233:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136083.078694:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136083.078740:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078749:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=556s v=(0 0) 00010000:00010000:3.0:1789136083.078753:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136083.078757:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078768:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078778:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078786:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.078813:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136083.079009:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136083.079026:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079030:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.079049:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136083.079050:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.079061:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079065:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136083.079072:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.079092:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079094:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079162:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079203:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000347279a3/0x38eb79866bf97271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.079225:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136083.079228:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136083.079232:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136083.079236:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.079244:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077518359/0x38eb79866bf9726a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.079271:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.079273:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.079276:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136083.081193:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136083.081210:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.081229:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=556s v=(0 0) 00010000:00010000:3.0:1789136083.081233:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136083.081240:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.081256:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.081275:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.081284:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.081310:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136083.083134:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.083155:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.083173:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.083179:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.083194:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.083221:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.083229:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d23455aa/0x38eb79866bf97278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.083288:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.083291:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.083293:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136083.084529:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136083.084548:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.084572:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=556s v=(0 0) 00010000:00010000:3.0:1789136083.084577:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136083.084586:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.084603:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.084614:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.084622:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.084664:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136083.085491:0:15518:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136083.085500:0:15518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.085512:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=556s v=(0 0) 00010000:00010000:3.0:1789136083.085516:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136083.085520:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.085531:0:15518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.085539:0:15518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.085546:0:15518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136083.085567:0:15518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136083.085668:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136083.085684:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085697:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.085741:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085755:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085782:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085790:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e3f7892/0x38eb79866bf9727f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789136083.085796:0:15518:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:2.0:1789136083.085822:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136083.085828:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085835:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136083.085857:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085866:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085880:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085887:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b27ef6/0x38eb79866bf97286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136083.085914:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.085916:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136083.085918:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136083.085946:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14856:x1876044723361536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116647us (116936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136083.085967:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136083.085985:0:14856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14856:1876044723361536:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789136083.086010:0:14856:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789136083.086077:0:14856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14856:1876044723361664:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136083.086156:0:14856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136083.086229:0:14856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65e40 going to sleep for 11 seconds 00010000:00010000:1.0:1789136083.086344:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136083.086519:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361664 00000100:00100000:3.0:1789136083.086540:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361664 00000100:00100000:3.0:1789136083.086634:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136083.086644:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14856:x1876044723361664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789136083.086733:0:15520:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789136083.104574:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14856:x1876044723361664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17911us (18397us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789136083.104602:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136083.104806:0:14856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14856:1876044723361664:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789136083.104833:0:14856:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789136083.405878:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136084.430983:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136085.453108:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789136086.166099:0:16237:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789136086.166105:0:16237:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789136086.166265:0:16237:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ba071cf7000 00000020:01000004:1.0:1789136086.166286:0:16237:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789136086.166302:0:16237:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789136086.166320:0:16237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ba0503b1a48) 00000020:00000080:1.0:1789136086.166347:0:16237:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789136086.194749:0:16237:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789136086.195044:0:16237:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789136086.196938:0:16237:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789136086.197286:0:16237:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789136086.198322:0:16237:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789136086.198881:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:0.0:1789136086.198982:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 515: rc = 0 00100000:10000000:0.0:1789136086.200941:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:0.0:1789136086.202508:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:0.0:1789136086.204791:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1789136086.205181:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:0.0:1789136086.205451:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1789136086.206306:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:0.0:1789136086.206602:0:16237:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:2.0:1789136086.207758:0:16237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789136086.207775:0:16237:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789136086.207788:0:16237:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x38eb79866bf97294 00000020:01000004:2.0:1789136086.207797:0:16237:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789136086.207827:0:16237:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789136086.207830:0:16237:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789136086.207838:0:16237:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789136086.207876:0:16237:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789136086.207882:0:16237:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789136086.233277:0:16237:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136086.233355:0:16237:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.141@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789136086.233360:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136086.233362:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136086.233364:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136086.233365:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136086.233366:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136086.233367:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136086.233369:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136086.233371:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136086.233372:0:16237:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136086.233376:0:16237:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789136086.233379:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136086.233380:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136086.233381:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136086.233382:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136086.233383:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136086.233385:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136086.233386:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136086.233387:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136086.233388:0:16237:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136086.233428:0:16237:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789136086.233457:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723361792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136086.233555:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136086.233637:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0448ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.234024:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361792 00000100:00100000:3.0:1789136086.234043:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361792 00000100:00100000:3.0:1789136086.234118:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789136086.234129:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:16237:x1876044723361792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136086.234179:0:14826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789136086.234182:0:14826:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789136086.234187:0:14826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789136086.256756:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:16237:x1876044723361792:12345-0@lo:253:mount.lustre.0 Request processed in 22614us (23184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.256775:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789136086.257222:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723361792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136086.257529:0:16237:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789136086.257533:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136086.257535:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136086.257536:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136086.257537:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136086.257539:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136086.257541:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136086.257542:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136086.257566:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136086.257568:0:16237:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136086.257596:0:16237:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ba071cf7000 from lustre-OST0001 10000000:01000000:2.0:1789136086.257641:0:16237:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789136086.257644:0:16237:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789136086.257654:0:16237:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ba074363490 local copy 00010000:00010000:2.0:1789136086.257669:0:16237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136086.258008:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723361920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136086.258082:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136086.258139:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.258426:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723361920 00000100:00100000:3.0:1789136086.258435:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723361920 00000100:00100000:3.0:1789136086.258495:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136086.258507:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:16237:x1876044723361920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.258782:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+16:16237:x1876044723361920:12345-0@lo:501:mount.lustre.0 Request processed in 277us (699us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789136086.258791:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789136086.258939:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723361920:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789136086.258956:0:16237:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789136086.259125:0:16237:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789136086.259135:0:16237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.259146:0:16237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072937a00/0x38eb79866bf97041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97048 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136086.259176:0:16237:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ba071cf7000 10000000:01000000:2.0:1789136086.259182:0:16237:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789136086.259188:0:16237:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789136086.259191:0:16237:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136086.259196:0:16237:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789136086.259199:0:16237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789136086.259230:0:16237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.259260:0:16237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.259272:0:16237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136086.259292:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136086.259396:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136086.259474:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c118840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.260123:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362048 00000100:00100000:0.0:1789136086.260132:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362048 00000100:00100000:0.0:1789136086.260241:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789136086.260409:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:16237:x1876044723362048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136086.260438:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136086.260458:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba049140600/0x38eb79866bf972a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9729b expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.260491:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba049140600/0x38eb79866bf972a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9729b expref: 17 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.260502:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba049140600/0x38eb79866bf972a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9729b expref: 17 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.260512:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140600, rc 0) 00000100:00100000:0.0:1789136086.260639:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362048:12345-0@lo:101:mount.lustre.0 Request processed in 389us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.260648:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789136086.260752:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136086.260771:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972a2 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.260783:0:16237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf972a2 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136086.262475:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789136086.263672:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136086.264208:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789136086.264279:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789136086.264331:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789136086.264384:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789136086.264433:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789136086.264465:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789136086.264542:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789136086.264551:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789136086.264670:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.264795:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.264856:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba058186300 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.265013:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362176 00000100:00100000:0.0:1789136086.265022:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362176 00000100:00100000:0.0:1789136086.265093:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789136086.265103:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136086.265757:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362176:12345-0@lo:501:mount.lustre.0 Request processed in 653us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.265768:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136086.265980:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136086.266054:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136086.266112:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136086.266152:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.266362:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362304 00000100:00100000:3.0:1789136086.266369:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362304 00000100:00100000:3.0:1789136086.266415:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789136086.266424:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136086.266804:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362304:12345-0@lo:503:mount.lustre.0 Request processed in 379us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.266812:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136086.266989:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136086.267950:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136086.268068:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136086.268141:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136086.268182:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.268412:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362432 00000100:00100000:3.0:1789136086.268419:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362432 00000100:00100000:3.0:1789136086.268459:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789136086.268468:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.268739:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362432:12345-0@lo:502:mount.lustre.0 Request processed in 269us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.268748:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136086.268868:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136086.269166:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789136086.269229:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789136086.269267:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789136086.269465:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789136086.269510:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789136086.269549:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789136086.269602:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789136086.269645:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789136086.269693:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789136086.269776:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136086.269845:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136086.269886:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.270115:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362560 00000100:00100000:3.0:1789136086.270123:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362560 00000100:00100000:3.0:1789136086.270178:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136086.270188:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.270601:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362560:12345-0@lo:502:mount.lustre.0 Request processed in 412us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.270621:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789136086.270769:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136086.270878:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789136086.270897:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789136086.272147:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789136086.272161:0:16238:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789136086.272171:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136086.272173:0:16238:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789136086.272183:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136086.272203:0:16238:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ba054360000) 00000020:00000080:2.0:1789136086.272238:0:16238:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789136086.272244:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136086.272398:0:16238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba071cf7000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789136086.272408:0:16238:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136086.272417:0:16238:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x38eb79866bf972b0 00010000:00010000:3.0:1789136086.279108:0:16238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789136086.279846:0:16238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789136086.282223:0:16238:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789136086.284485:0:16238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789136086.284501:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.284509:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.284512:0:16238:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789136086.284516:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.284521:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.284523:0:16238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789136086.284526:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789136086.284528:0:16238:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789136086.284531:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.284533:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.284535:0:16238:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789136086.284537:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.284539:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.284541:0:16238:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789136086.284544:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789136086.284589:0:16238:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.284593:0:16238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.284595:0:16238:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136086.284598:0:16238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789136086.284993:0:16237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789136086.285027:0:16237:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789136086.285091:0:16237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972a2 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.285116:0:16237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0ee00/0x38eb79866bf9729b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972a2 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136086.287662:0:16237:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba071cf7000 from 1 10000000:01000000:1.0:1789136086.287675:0:16237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136086.287758:0:16237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.287786:0:16237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.287803:0:16237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136086.287840:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136086.287943:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136086.287996:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.293868:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362688 00000100:00100000:0.0:1789136086.293891:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362688 00000100:00100000:0.0:1789136086.293984:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789136086.293996:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+17:16237:x1876044723362688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136086.294018:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136086.294044:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf972b7 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.294848:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.294864:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.294876:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049141c00, rc 0) 00000100:00100000:0.0:1789136086.294987:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723362688:12345-0@lo:101:mount.lustre.0 Request processed in 992us (7043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.294996:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136086.295199:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136086.295223:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.295234:0:16237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136086.297538:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789136086.300946:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136086.301683:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789136086.301783:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789136086.301929:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789136086.301939:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789136086.302080:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.302185:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.302254:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136086.302331:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362816 00000100:00100000:2.0:1789136086.302341:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362816 00000100:00100000:2.0:1789136086.302412:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789136086.302423:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723362816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136086.302730:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723362816:12345-0@lo:501:mount.lustre.0 Request processed in 307us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136086.302740:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789136086.302903:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.302943:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136086.302987:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.303021:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.303120:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723362944 00000100:00100000:0.0:1789136086.303124:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723362944 00000100:00100000:0.0:1789136086.303166:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789136086.303175:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723362944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136086.303636:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723362944:12345-0@lo:503:mount.lustre.0 Request processed in 461us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.303656:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789136086.303913:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723362944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136086.304596:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136086.304763:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.304856:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.304906:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136086.304991:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363072 00000100:00100000:2.0:1789136086.304998:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363072 00000100:00100000:2.0:1789136086.305058:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789136086.305068:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723363072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136086.305395:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723363072:12345-0@lo:502:mount.lustre.0 Request processed in 328us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136086.305405:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136086.305546:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136086.305957:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789136086.306029:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789136086.306099:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789136086.306139:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789136086.306173:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789136086.306250:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789136086.306299:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789136086.306465:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789136086.306517:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789136086.306551:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789136086.306595:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789136086.306642:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.306860:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.306940:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136086.306982:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363200 00000100:00100000:2.0:1789136086.306990:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363200 00000100:00100000:2.0:1789136086.307079:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789136086.307089:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723363200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136086.307323:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723363200:12345-0@lo:502:mount.lustre.0 Request processed in 234us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136086.307332:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136086.307425:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136086.307509:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789136086.307522:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789136086.308677:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.308693:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308696:0:16242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789136086.308742:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba071cf7000 00000020:00000080:3.0:1789136086.308745:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136086.308753:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.308756:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308758:0:16242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789136086.308760:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.308763:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308764:0:16242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789136086.308768:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ba071cf7000 00000020:00000080:3.0:1789136086.308771:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136086.308844:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.308847:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308849:0:16242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136086.308851:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.308854:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308856:0:16242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136086.308859:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba071cf7000 00000020:00000080:3.0:1789136086.308870:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136086.308889:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.308892:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308894:0:16242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136086.308896:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136086.308899:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308900:0:16242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136086.308904:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ba071cf7000 00000020:00000080:3.0:1789136086.308906:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136086.308941:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136086.308945:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136086.308947:0:16242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789136086.308950:0:16242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789136086.313911:0:16237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789136086.313975:0:16237:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136086.314009:0:16237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.314025:0:16237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136086.314122:0:16237:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789136086.314125:0:16237:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ba071cf7000 10000000:01000000:0.0:1789136086.314129:0:16237:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ba071cf7000 10000000:01000000:0.0:1789136086.314134:0:16237:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136086.314143:0:16237:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ba071cf7000 from 1 10000000:01000000:0.0:1789136086.314146:0:16237:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789136086.314204:0:16237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.314214:0:16237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136086.314227:0:16237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136086.314262:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136086.314442:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136086.314505:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044c55240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136086.314622:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363328 00000100:00100000:2.0:1789136086.314632:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363328 00000100:00100000:2.0:1789136086.314726:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789136086.314739:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723363328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136086.314759:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136086.314778:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf972cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf972c5 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.314832:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf972cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf972c5 expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.314846:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e600/0x38eb79866bf972cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf972c5 expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.314857:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e600, rc 0) 00000100:00100000:2.0:1789136086.314915:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363328:12345-0@lo:101:mount.lustre.0 Request processed in 179us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136086.314924:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136086.315063:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136086.315083:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972cc expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.315094:0:16237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf972cc expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136086.317272:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789136086.319796:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136086.320247:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789136086.320298:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789136086.322851:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789136086.322972:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789136086.323014:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789136086.323113:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789136086.325260:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789136086.325418:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789136086.325522:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789136086.325564:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789136086.325611:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789136086.325661:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789136086.325694:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789136086.329471:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789136086.329592:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789136086.329633:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789136086.329665:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789136086.329747:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789136086.329819:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789136086.329854:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789136086.329904:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789136086.329944:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789136086.329984:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789136086.330036:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789136086.330087:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789136086.330124:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789136086.330172:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789136086.330206:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789136086.330236:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789136086.330282:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789136086.330319:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789136086.330354:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789136086.330390:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789136086.330456:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789136086.330511:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789136086.330564:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789136086.330603:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789136086.330757:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789136086.330765:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789136086.330932:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.331027:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.334373:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.335455:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363456 00000100:00100000:0.0:1789136086.335470:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363456 00000100:00100000:0.0:1789136086.335549:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789136086.335562:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136086.336005:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363456:12345-0@lo:501:mount.lustre.0 Request processed in 445us (4977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.336014:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136086.336194:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136086.336266:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136086.337434:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.337490:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.337581:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363584 00000100:00100000:0.0:1789136086.337589:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363584 00000100:00100000:0.0:1789136086.337636:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789136086.337647:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136086.338060:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363584:12345-0@lo:503:mount.lustre.0 Request processed in 402us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.338068:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136086.338191:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136086.339040:0:16237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136086.339168:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.339246:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.339286:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.339426:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363712 00000100:00100000:0.0:1789136086.339434:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363712 00000100:00100000:0.0:1789136086.339482:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789136086.339493:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136086.339861:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363712:12345-0@lo:502:mount.lustre.0 Request processed in 368us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.339872:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136086.341599:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136086.342038:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789136086.342123:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789136086.342160:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789136086.342210:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789136086.342247:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789136086.345420:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789136086.345597:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789136086.345637:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789136086.345746:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789136086.345806:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789136086.345841:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789136086.345891:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789136086.345927:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789136086.345962:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789136086.346015:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789136086.346067:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789136086.346106:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789136086.346158:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789136086.346207:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789136086.350578:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789136086.350747:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789136086.350791:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789136086.350827:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789136086.350877:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789136086.350913:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789136086.350967:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789136086.351017:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789136086.351068:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789136086.351103:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789136086.351149:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789136086.351184:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789136086.351214:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789136086.351245:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789136086.351294:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789136086.352745:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789136086.352837:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789136086.352873:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789136086.352906:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789136086.352951:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789136086.352986:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789136086.353062:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136086.353180:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.353240:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136086.353449:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363840 00000100:00100000:0.0:1789136086.353459:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363840 00000100:00100000:0.0:1789136086.353535:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789136086.353547:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136086.353866:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723363840:12345-0@lo:502:mount.lustre.0 Request processed in 320us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136086.353876:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136086.354613:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723363840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136086.354784:0:16237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789136086.354801:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789136086.363579:0:16247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789136086.363612:0:16247:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ba054361a48) 00000020:00000080:2.0:1789136086.363644:0:16247:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789136086.363778:0:16247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ba071cf7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136086.363784:0:16247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ba071cf7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789136086.363787:0:16247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ba071cf7000 3 00010000:00080000:2.0:1789136086.363829:0:16247:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ba0491ee800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.141@tcp at head 00010000:00010000:3.0:1789136086.368918:0:16247:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789136086.369203:0:16247:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789136086.369254:0:16247:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136086.369277:0:16247:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x38eb79866bf972da 00000100:00080000:3.0:1789136086.369291:0:16247:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136086.369298:0:16247:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ba0491ee800 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136086.371501:0:16247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4e940 x1876044723363968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136086.371552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723363968:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136086.371645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.371743:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723363968 00000100:00100000:3.0:1789136086.371751:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723363968 00000100:00100000:3.0:1789136086.371798:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136086.371807:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1876044723363968:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789136086.371841:0:14834:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:3.0:1789136086.371904:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x38eb79866bf972e1 00000004:00100000:3.0:1789136086.371923:0:14834:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136086.371968:0:14834:0:(import.c:65:import_set_state_nolock()) ffff8ba07643b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136086.372028:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876044723363968:12345-0@lo:38:llog_process_th.0 Request processed in 221us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.372036:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789136086.372097:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4e940 x1876044723363968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136086.372107:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136086.372117:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789136086.372125:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789136086.372130:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136086.372132:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba0491ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136086.372138:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1876044723363968:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789136086.372167:0:16247:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136086.372225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136086.372230:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136086.372233:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136086.372237:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:3.0:1789136086.372242:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136086.372248:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba043462000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136086.372265:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4da40 x1876044723364224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136086.377640:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723364096:0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.377774:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.377865:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364096 00000100:00100000:3.0:1789136086.377874:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364096 00000100:00100000:3.0:1789136086.377946:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136086.377958:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723364096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.378020:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044723364096:12345-0@lo:400:kworker.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.378029:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789136086.378068:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136086.378114:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723364096:0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.378182:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723364352:0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.378216:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.378252:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364352 00000100:00100000:3.0:1789136086.378256:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364352 00000100:00100000:3.0:1789136086.378289:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136086.378307:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723364352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136086.378420:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723364224:0@lo:8:kworker.0 00000100:00100000:2.0:1789136086.378457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136086.379129:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364224 00000100:00100000:1.0:1789136086.379136:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364224 00000100:00100000:1.0:1789136086.379169:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136086.379176:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723364224:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789136086.379247:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723364224:12345-0@lo:8:kworker.0 Request processed in 70us (788us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789136086.379254:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136086.379288:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136086.379297:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136086.379303:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789136086.379441:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723364352:12345-0@lo:400:kworker.0 Request processed in 1136us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.379450:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789136086.379497:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4e940 x1876044723364352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136086.379509:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723364352:0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.379567:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723364480:0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.379598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.379632:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364480 00000100:00100000:3.0:1789136086.379637:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364480 00000100:00100000:3.0:1789136086.379670:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136086.379677:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723364480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136086.379725:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044723364480:12345-0@lo:400:kworker.0 Request processed in 49us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.379732:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789136086.379747:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789136086.379766:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ba072f4e940 x1876044723364480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136086.379775:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044723364480:0@lo:400:kworker.0 00000040:00080000:3.0:1789136086.381634:0:16247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789136086.381802:0:16237:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789136086.381831:0:16237:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789136086.381850:0:16237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972cc expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.381874:0:16237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba049141200/0x38eb79866bf972c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972cc expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789136086.381943:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789136086.381945:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136086.381947:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136086.381948:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136086.381950:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136086.381952:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136086.381954:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136086.381955:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136086.381957:0:16237:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136086.381962:0:16237:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789136086.381964:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136086.381965:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136086.381966:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136086.381968:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136086.381969:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136086.381970:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136086.381971:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136086.381973:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136086.381974:0:16237:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136086.382008:0:16237:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789136086.382031:0:16237:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723364608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136086.382123:0:16237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136086.382166:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364608 00000100:00100000:3.0:1789136086.382173:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364608 00000100:00100000:3.0:1789136086.382223:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789136086.382233:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:16237:x1876044723364608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136086.382287:0:14828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789136086.382303:0:14828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789136086.382412:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723364224:0@lo:8:kworker.0 00000100:00100000:2.0:1789136086.383239:0:16237:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044bdf3c0 going to sleep for 11 seconds 20000000:01000000:3.0:1789136086.432222:0:14828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789136086.432250:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789136086.432426:0:14849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136086.432434:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136086.432478:0:14849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.432502:0:14849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf971bb expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.432524:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.432580:0:14849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.432600:0:14849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 19 pid: 14826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136086.432618:0:14849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723364736:0@lo:104: 00000100:00100000:2.0:1789136086.432759:0:14849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136086.432816:0:14849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba044774e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136086.432990:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364736 00000100:00100000:3.0:1789136086.432999:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364736 00000100:00100000:3.0:1789136086.433512:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136086.433528:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723364736:12345-0@lo:104: 00010000:00010000:3.0:1789136086.433805:0:14817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.433996:0:14817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136086.434005:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2dc02be1-e923-45bb-814e-7c82b120b447+3:14849:x1876044723364736:12345-0@lo:104: Request processed in 482us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136086.434014:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136086.434165:0:14849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14849:1876044723364736:0@lo:104: 00010000:00010000:2.0:1789136086.434201:0:14849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434311:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136086.434320:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434328:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5e00 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789136086.434333:0:16066:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434359:0:16066:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136086.434367:0:16066:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136086.434374:0:16066:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136086.434427:0:16066:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434434:0:16066:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136086.434471:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434479:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5e00/0x38eb79866bf971bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf971c2 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136086.434498:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136086.434500:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136086.434501:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136086.434511:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136086.434526:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2dc02be1-e923-45bb-814e-7c82b120b447:3314:1876044723364864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136086.434575:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136086.434661:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364864 00000100:00100000:2.0:1789136086.434667:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364864 00010000:00010000:2.0:1789136086.434899:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 20 pid: 14826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136086.434936:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136086.434945:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+20:3314:x1876044723364864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136086.434957:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136086.434962:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 20 pid: 14826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.434973:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 20 pid: 14826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435000:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0738a7e00/0x38eb79866bf971c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf971bb expref: 20 pid: 14826 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435016:0:14818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435024:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789136086.435040:0:14818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003298807s 00010000:00010000:2.0:1789136086.435056:0:14818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435063:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435071:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435078:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435084:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba085a0f600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136086.435088:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435096:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435118:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136086.435138:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136086.435177:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3314:x1876044723364864:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136086.435184:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789136086.435407:0:14849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.435416:0:14849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136086.435422:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf972e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136086.435591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2dc02be1-e923-45bb-814e-7c82b120b447:3314:1876044723364864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136086.447184:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+18:16237:x1876044723364608:12345-0@lo:253:mount.lustre.0 Request processed in 64934us (65043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136086.447203:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789136086.447487:0:16237:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2dc02be1-e923-45bb-814e-7c82b120b447:16237:1876044723364608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136086.447510:0:16237:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789136086.447514:0:16237:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136086.447515:0:16237:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136086.447517:0:16237:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136086.447518:0:16237:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136086.447519:0:16237:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136086.447521:0:16237:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136086.447522:0:16237:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136086.447525:0:16237:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136086.447526:0:16237:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136086.447547:0:16237:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789136086.455521:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136086.455801:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789136086.455970:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136086.456239:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789136086.456552:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789136086.456772:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789136086.458385:0:16237:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789136086.477637:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789136086.521065:0:16237:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789136086.521081:0:16237:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789136086.521132:0:16237:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789136086.521221:0:16237:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789136086.521245:0:16237:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789136086.521286:0:16237:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:1.0:1789136087.391673:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789136087.392334:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789136087.502467:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789136087.502533:0:14830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789136087.502538:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ba073580000 from 8 10000000:01000000:0.0:1789136087.502542:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789136087.502598:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136087.502609:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136087.502621:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136087.502651:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723364992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136087.502869:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136087.502954:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136087.503980:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723364992 00000100:00100000:2.0:1789136087.503990:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723364992 00000100:00100000:2.0:1789136087.504098:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789136087.504108:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723364992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136087.504125:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136087.504144:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf972f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf972ef expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136087.504171:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf972f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf972ef expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136087.504182:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f800/0x38eb79866bf972f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf972ef expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136087.504202:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f800, rc 0) 00000100:00100000:2.0:1789136087.504266:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723364992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136087.504273:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789136087.504511:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723364992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136087.504531:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972f6 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136087.504539:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf972f6 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136087.504600:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723365120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789136087.504638:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136087.504680:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0593a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136087.504694:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365120 00000100:00100000:0.0:1789136087.504716:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365120 00000100:00100000:0.0:1789136087.504742:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789136087.504756:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723365120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136087.504771:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136087.504788:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136087.504791:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789136087.504871:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723365120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136087.504891:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789136087.504928:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723365120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789136087.504983:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789136087.504990:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972f6 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136087.504999:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba049140800/0x38eb79866bf972ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf972f6 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136088.272163:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723365248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136088.272391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136088.274591:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365248 00000100:00100000:3.0:1789136088.274607:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365248 00000100:00100000:3.0:1789136088.274739:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136088.274767:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723365248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136088.274815:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136088.274907:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723365248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136088.274915:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136088.275220:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789136088.275251:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723365248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789136088.275518:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136088.529444:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136089.103465:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136089.552537:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136090.572979:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.597552:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136091.856804:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136091.856811:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136091.856815:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136091.856827:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ba043462000 using connection 192.168.204.141@tcp/0@lo 00000100:00100000:3.0:1789136091.856851:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ba072f4e940 x1876044723365632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136091.856885:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723365376:0@lo:400:kworker.0 00000100:00100000:3.0:1789136091.856916:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723365504:0@lo:400:kworker.0 00000100:00100000:2.0:1789136091.857125:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723365760:0@lo:400:kworker.0 00000100:00100000:3.0:1789136091.857747:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136091.857803:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136091.857811:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723366016:0@lo:400:kworker.0 00000100:00100000:3.0:1789136091.857840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136091.857874:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366016 00000100:00100000:3.0:1789136091.857880:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366016 00000100:00100000:3.0:1789136091.857934:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136091.857955:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723366016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136091.858011:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044723366016:12345-0@lo:400:kworker.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136091.858018:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789136091.858040:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789136091.858185:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f7cb40 x1876044723366016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136091.858209:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044723366016:0@lo:400:kworker.0 00000100:00100000:0.0:1789136091.858303:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365504 00000100:00100000:0.0:1789136091.858308:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365504 00000100:00100000:0.0:1789136091.858348:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136091.858356:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723365504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136091.858404:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723365504:12345-0@lo:400:kworker.0 Request processed in 49us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136091.858411:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789136091.858426:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136091.858614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723365504:0@lo:400:kworker.0 00000100:00100000:0.0:1789136091.859386:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723365632:0@lo:8:kworker.0 00000100:00100000:0.0:1789136091.859435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136091.859503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136091.859639:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365632 00000100:00100000:1.0:1789136091.859645:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365632 00000100:00100000:1.0:1789136091.859679:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136091.859685:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1876044723365632:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789136091.859736:0:15520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:1.0:1789136091.859775:0:15520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x38eb79866bf972fd 00002000:00100000:1.0:1789136091.859792:0:15520:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ba04857e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789136091.859797:0:15520:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789136091.860894:0:15520:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789136091.862037:0:15520:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789136091.862076:0:15520:0:(import.c:65:import_set_state_nolock()) ffff8ba048579800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136091.862168:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876044723365632:12345-0@lo:8:kworker.0 Request processed in 2480us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136091.862178:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789136091.862217:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072f4e940 x1876044723365632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136091.862234:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789136091.862244:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789136091.862250:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789136091.862252:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8ba043462000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789136091.862272:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789136091.862278:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1876044723365632:0@lo:8:kworker.0 00000004:00080000:0.0:1789136091.862339:0:14858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789136091.862363:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136091.862396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136091.862406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723365888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136091.862868:0:14858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14858:1876044723366272:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789136091.862895:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365376 00000100:00100000:1.0:1789136091.862901:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365376 00000100:00100000:0.0:1789136091.862901:0:14858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136091.862918:0:14858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06041e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136091.862933:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723366144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136091.862971:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136091.863006:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789136091.863016:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723365376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136091.863054:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723365376:12345-0@lo:400:kworker.0 Request processed in 40us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136091.863131:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789136091.863164:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366144 00000100:00100000:0.0:1789136091.863167:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366144 00000100:00100000:0.0:1789136091.863206:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136091.863212:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723366144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136091.863238:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789136091.863277:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044723366144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136091.863292:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136091.863314:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366272 00000100:00100000:0.0:1789136091.863318:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366272 00000100:00100000:0.0:1789136091.863339:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136091.863580:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14858:x1876044723366272:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789136091.863956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136091.864168:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365760 00000004:00080000:3.0:1789136091.864173:0:14857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789136091.864174:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365760 00000100:00100000:2.0:1789136091.864203:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723365888 00000100:00100000:2.0:1789136091.864206:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723365888 00000100:00100000:2.0:1789136091.864241:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136091.864248:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723365760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136091.864290:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044723365760:12345-0@lo:400:kworker.0 Request processed in 42us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136091.864296:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136091.864308:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136091.864314:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723365888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136091.864339:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eeed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723365888:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136091.864354:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789136091.864435:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba085f7c3c0 x1876044723365888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136091.864450:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723365888:0@lo:400:kworker.0 00010000:00080000:2.0:1789136091.864461:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072f4da40 x1876044723365760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136091.864469:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044723365760:0@lo:400:kworker.0 00000004:00080000:3.0:1789136091.865030:0:14857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565739328444ns, next at 0ns, rc = 0 00000100:00080000:1.0:1789136091.865381:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136091.865386:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789136091.865777:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c09b840 x1876044723366144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136091.865798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c09b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723366144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136091.866138:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072f4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723365376:0@lo:400:kworker.0 00002000:00080000:0.0:1789136091.875198:0:15521:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789136091.875210:0:15521:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789136091.875216:0:15521:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1789136091.901102:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.901114:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901132:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.901137:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.901144:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901162:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901172:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901180:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901213:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136091.901228:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136091.901234:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901242:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136091.901247:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901256:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901273:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901281:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97304 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901297:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136091.901300:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136091.901302:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.901968:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.901975:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.901985:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.901993:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.901998:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.902009:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.902018:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.902025:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.902044:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136091.902809:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.902817:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.902826:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.902830:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.902840:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.902860:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.902867:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74522fa/0x38eb79866bf9730b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.902887:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.902896:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.902899:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.904013:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.904022:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.904036:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.904040:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.904047:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.904071:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.904081:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.904095:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.904118:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136091.904125:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136091.904133:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.904144:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136091.904149:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.904161:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.904178:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.904190:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd24738/0x38eb79866bf97312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.904208:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.904211:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.904213:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.908162:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.908178:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908196:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.908200:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.908206:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908222:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908232:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908239:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908266:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.908895:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.908904:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908921:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.908925:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.908930:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908951:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908960:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908967:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.908989:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136091.909015:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136091.909025:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909034:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.909039:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909049:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909072:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909080:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf97319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909108:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136091.909112:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909119:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.909122:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909129:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909140:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909148:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf97320 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.909159:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.909161:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.909163:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.909402:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.909408:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909416:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.909420:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.909423:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909432:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909451:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909457:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909480:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.909887:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.909893:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909902:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.909905:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.909909:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909917:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909925:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909931:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.909966:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136091.910388:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.910397:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910405:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.910408:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136091.910412:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136091.910412:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910418:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910420:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910427:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136091.910428:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910436:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910437:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910445:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136091.910447:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910460:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910468:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf97327 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910482:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136091.910485:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910491:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.910494:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910502:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910511:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910518:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf9732e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910536:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136091.910540:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910547:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.910550:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910558:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910569:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910576:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf97335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910587:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.910589:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.910590:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.910624:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.910828:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.910834:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910842:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.910851:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.910856:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910867:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910874:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910881:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.910896:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136091.910962:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136091.910967:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910974:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.910983:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.910991:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.911003:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.911010:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9733c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.911024:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.911026:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.911028:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.911574:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.912863:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.912874:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.912889:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.912893:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.912898:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.912910:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.912919:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.912933:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.913517:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.918125:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789136091.918135:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136091.918138:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918145:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918153:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136091.918157:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1789136091.918158:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.918161:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.918168:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918169:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.918183:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918190:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.918191:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.918200:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918203:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97343 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.918216:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136091.918218:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136091.918234:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918241:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.918244:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918260:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918271:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918279:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf9734a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.918290:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.918292:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.918293:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.918299:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.921591:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.921605:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.921629:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.921633:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.921640:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.921656:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.921666:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.921674:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.921712:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136091.921909:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136091.921917:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.921931:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.921935:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.921959:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.921975:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.921982:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.922002:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.922004:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.922006:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136091.930001:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.930018:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930037:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.930049:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.930056:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930080:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930092:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930099:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930120:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136091.930135:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136091.930140:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930149:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136091.930154:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930163:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930180:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930199:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf97358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.930219:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.930221:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.930223:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136091.931735:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.931746:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.931763:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.931768:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.931775:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.931787:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.931795:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.931803:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.931822:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136091.932254:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.932266:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.932274:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.932277:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.932280:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.932289:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.932296:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.932303:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.932320:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136091.932665:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136091.932674:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.932682:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136091.932687:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.932741:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932840:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.932847:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932855:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.932859:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932866:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932880:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932888:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ada6683/0x38eb79866bf97366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.932905:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.932907:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.932908:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.934950:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.934970:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f118f5a4/0x38eb79866bf9735f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136091.934999:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.935002:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136091.935004:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136091.937832:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.937847:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.937865:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.937870:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.937877:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.937891:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939486:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939498:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939521:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136091.939539:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136091.939545:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939552:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136091.939557:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939565:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939585:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939592:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf06c4e/0x38eb79866bf9736d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.939614:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.939622:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.939624:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136091.940339:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.940347:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.940649:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.940653:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.940660:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.940675:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.940684:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.940692:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.940733:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136091.941494:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.941502:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.941512:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.941523:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.941533:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.941549:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.941556:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002862cead/0x38eb79866bf97374 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.941574:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.941575:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.941577:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136091.942628:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789136091.942638:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942652:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1789136091.942656:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136091.942663:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942683:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942692:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942719:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942740:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136091.942751:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136091.942756:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942763:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136091.942766:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942773:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942786:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942792:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab80d040/0x38eb79866bf9737b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.942815:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.942817:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.942819:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.945743:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.945756:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.945774:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.945780:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.945787:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.945801:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.945823:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.945831:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.945853:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.946290:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.946297:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946305:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.946308:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.946312:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946320:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946328:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946335:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946379:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136091.946801:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.946807:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946816:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.946818:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.946822:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946831:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946839:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946846:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.946862:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789136091.947257:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.947263:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947271:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.947281:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.947285:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947295:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947304:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947310:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947318:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789136091.947745:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.947751:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947761:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.947764:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.947768:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947778:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947785:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947798:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.947807:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789136091.948268:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789136091.948279:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948287:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.948292:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948302:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948320:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948334:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d1d0ae/0x38eb79866bf97382 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948634:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789136091.948638:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948645:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.948649:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948657:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948667:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948674:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195af498/0x38eb79866bf97389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948686:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136091.948690:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948695:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140200 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.948735:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948743:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948754:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948762:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0418cb/0x38eb79866bf97390 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948774:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136091.948777:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948783:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.948786:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948793:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948802:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948809:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002337424e/0x38eb79866bf97397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948829:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.948832:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948838:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.948842:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948849:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948859:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948867:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004efc6fbd/0x38eb79866bf9739e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.948879:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.948880:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.948882:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136091.951501:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.951513:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.951532:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.951537:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.951543:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.951558:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.951568:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.951576:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.951594:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.952076:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.952083:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952098:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.952102:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.952106:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952116:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952124:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952131:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952139:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136091.952418:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136091.952428:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952439:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141e00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.952451:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952462:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952483:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952491:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1aa607/0x38eb79866bf973a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952514:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.952519:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952525:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141600 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.952529:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952536:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136091.952539:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.952550:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952553:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952565:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1789136091.952567:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7de6f0/0x38eb79866bf973ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952570:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.952575:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952596:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952598:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.952601:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.952605:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136091.952620:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952628:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.952650:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136091.952671:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.952677:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952684:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.952687:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.952695:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136091.953087:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.953094:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953103:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.953106:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.953110:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953119:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953126:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953134:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953152:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136091.953531:0:15521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789136091.953536:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.953545:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1789136091.953548:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136091.953553:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.953929:0:14821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136091.953947:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.953956:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136091.953959:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.953968:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.953983:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.953991:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208547cb/0x38eb79866bf973ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136091.954009:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.954011:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.954013:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.954020:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789136091.954032:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789136091.954170:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.954182:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.954189:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136091.954246:0:15521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789136091.954777:0:15521:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1789136091.954883:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14858:x1876044723366272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91533us (91975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136091.954897:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136091.954968:0:14858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14858:1876044723366272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789136091.954995:0:14858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789136091.955042:0:14858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14858:1876044723366400:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789136091.955156:0:14858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136091.955197:0:14858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136091.955217:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366400 00000100:00100000:0.0:1789136091.955222:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366400 00010000:00010000:2.0:1789136091.955261:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136091.955271:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789136091.955272:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd89f544/0x38eb79866bf973b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136091.955279:0:15518:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136091.955284:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14858:x1876044723366400:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789136091.955291:0:15518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:2.0:1789136091.955296:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136091.955302:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.955310:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136091.955321:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.955331:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789136091.955333:0:15521:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1789136091.955348:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.955356:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021038eb0/0x38eb79866bf973c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136091.955370:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.955372:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136091.957172:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136091.957413:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136091.968930:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14858:x1876044723366400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13640us (13763us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789136091.968954:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136091.972162:0:14858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14858:1876044723366400:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789136091.972183:0:14858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789136092.621619:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136093.389141:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723366528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136093.389222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136093.400964:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366528 00000100:00100000:0.0:1789136093.400979:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366528 00000100:00100000:0.0:1789136093.401904:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136093.402020:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723366528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136093.402066:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789136093.402159:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c0992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723366528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (12939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.402167:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136093.402224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723366528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789136093.402398:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136093.645597:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136094.042885:0:16596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789136094.670903:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136095.693068:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136096.717955:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136096.829062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.830578:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105088 00000100:00100000:2.0:1789136096.830598:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105088 00000100:00100000:2.0:1789136096.830656:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:2.0:1789136096.830665:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1876044696105088:12345-192.168.204.41@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789136096.830729:0:14826:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d@192.168.204.41@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:2.0:1789136096.830772:0:14826:0:(genops.c:1385:class_connect()) connect: client c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d, cookie 0x38eb79866bf973c8 00000100:00080000:2.0:1789136096.830972:0:14826:0:(import.c:65:import_set_state_nolock()) ffff8ba0491e8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136096.831068:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+5:2362:x1876044696105088:12345-192.168.204.41@tcp:250:mount.lustre.0 Request processed in 401us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.831077:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 75 00000100:00100000:3.0:1789136096.839311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136096.839400:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105216 00000100:00100000:0.0:1789136096.839422:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105216 00000100:00100000:0.0:1789136096.839491:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 76 00000100:00100000:0.0:1789136096.839502:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+5:13990:x1876044696105216:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136096.839522:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136096.839546:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba049141e00/0x38eb79866bf973cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630309 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.839582:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba049141e00/0x38eb79866bf973cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630309 expref: 6 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.839596:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba049141e00/0x38eb79866bf973cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630309 expref: 6 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.839606:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049141e00, rc 0) 00000100:00100000:0.0:1789136096.839688:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+6:13990:x1876044696105216:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136096.839696:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 76 00000100:00100000:0.0:1789136096.852685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.852877:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105344 00000100:00100000:2.0:1789136096.852890:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105344 00000100:00100000:2.0:1789136096.852981:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:2.0:1789136096.852992:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+6:13990:x1876044696105344:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136096.853452:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+6:13990:x1876044696105344:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 459us (781us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789136096.853461:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 77 00000100:00100000:3.0:1789136096.856695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.859268:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105472 00000100:00100000:2.0:1789136096.859290:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105472 00000100:00100000:2.0:1789136096.859369:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:2.0:1789136096.859381:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+6:13990:x1876044696105472:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136096.859403:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136096.859427:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0fa00/0x38eb79866bf973d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630310 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.859462:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0fa00/0x38eb79866bf973d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630310 expref: 7 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.859475:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0fa00/0x38eb79866bf973d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630310 expref: 7 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.859486:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0fa00, rc 0) 00000100:00100000:2.0:1789136096.859575:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+7:13990:x1876044696105472:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 195us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.859583:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 78 00000100:00100000:3.0:1789136096.862828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136096.863157:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105600 00000100:00100000:0.0:1789136096.863169:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105600 00000100:00100000:0.0:1789136096.863234:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:0.0:1789136096.863245:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+7:13990:x1876044696105600:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789136096.863632:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:13990:x1876044696105600:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 388us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136096.863641:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 79 00000100:00100000:0.0:1789136096.867533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136096.867621:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105728 00000100:00100000:3.0:1789136096.867633:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105728 00000100:00100000:3.0:1789136096.867736:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:3.0:1789136096.867747:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:13990:x1876044696105728:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789136096.868637:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:13990:x1876044696105728:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 885us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136096.868650:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 80 00000100:00100000:3.0:1789136096.873487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136096.873536:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105856 00000100:00100000:3.0:1789136096.873548:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105856 00000100:00100000:3.0:1789136096.873627:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:3.0:1789136096.873638:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:14008:x1876044696105856:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136096.878616:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:14008:x1876044696105856:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 4960us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136096.878636:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 81 00000100:00100000:2.0:1789136096.909352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.909409:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696105984 00000100:00100000:2.0:1789136096.909424:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696105984 00000100:00100000:2.0:1789136096.909504:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 82 00000100:00100000:2.0:1789136096.909517:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:14008:x1876044696105984:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136096.911529:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:14008:x1876044696105984:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 2003us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.911546:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 82 00000100:00100000:3.0:1789136096.922724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.925907:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106112 00000100:00100000:2.0:1789136096.925928:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106112 00000100:00100000:2.0:1789136096.926029:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:2.0:1789136096.926042:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+8:13990:x1876044696106112:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136096.926064:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136096.926090:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf973dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63033a expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.929456:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf973dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63033a expref: 9 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.929483:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f600/0x38eb79866bf973dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63033a expref: 9 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.929496:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f600, rc 0) 00000100:00100000:2.0:1789136096.948882:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+9:13990:x1876044696106112:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 22823us (26167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.948898:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 83 00000100:00100000:3.0:1789136096.957762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.958491:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106240 00000100:00100000:2.0:1789136096.958507:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106240 00000100:00100000:2.0:1789136096.958570:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:2.0:1789136096.958581:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+9:13990:x1876044696106240:12345-192.168.204.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789136096.958618:0:14826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789136096.958650:0:14826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136096.958655:0:14826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789136096.958658:0:14826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789136096.958661:0:14826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789136096.969631:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+9:13990:x1876044696106240:12345-192.168.204.41@tcp:256:mount.lustre.0 Request processed in 11034us (11863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136096.969651:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 84 00000100:00100000:1.0:1789136096.974949:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136096.974978:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723366656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136096.975076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136096.975175:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366656 00000100:00100000:1.0:1789136096.975185:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366656 00000100:00100000:1.0:1789136096.975416:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136096.975428:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723366656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136096.975467:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789136096.975519:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044723366656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136096.975526:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136096.975582:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723366656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136096.976648:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723367168:0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.976736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.976768:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136096.976773:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723367040:0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.976798:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.976854:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367168 00000100:00100000:2.0:1789136096.976860:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367168 00000100:00100000:2.0:1789136096.976904:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367040 00000100:00100000:2.0:1789136096.976907:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367040 00000100:00100000:2.0:1789136096.976930:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136096.976939:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723367168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.976987:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044723367168:12345-0@lo:400:kworker.0 Request processed in 49us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.976995:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136096.977010:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136096.977016:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.977044:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044723367040:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.977050:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789136096.977094:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba072eec780 x1876044723367040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136096.977455:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723366784:0@lo:400:kworker.0 00000100:00100000:0.0:1789136096.977509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136096.977545:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723367296:0@lo:400:kworker.0 00000100:00100000:0.0:1789136096.977577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136096.977595:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136096.977602:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723366912:0@lo:400:kworker.0 00000100:00100000:0.0:1789136096.977630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.977868:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044723367040:0@lo:400:kworker.0 00010000:00080000:2.0:1789136096.977888:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c398f00 x1876044723367168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136096.977907:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044723367168:0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.977940:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367296 00000100:00100000:2.0:1789136096.977944:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367296 00000100:00100000:2.0:1789136096.977989:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136096.977997:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723367296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.978048:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876044723367296:12345-0@lo:400:kworker.0 Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.978055:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789136096.978086:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ba05c398000 x1876044723367296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136096.978097:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1876044723367296:0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.980356:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366784 00000100:00100000:2.0:1789136096.980374:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366784 00000100:00100000:2.0:1789136096.980452:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789136096.980464:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723366784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.980565:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723366784:12345-0@lo:400:kworker.0 Request processed in 103us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.980573:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789136096.980639:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723366784:0@lo:400:kworker.0 00000100:00100000:2.0:1789136096.980739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.980765:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106368 00000100:00100000:2.0:1789136096.980769:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106368 00000100:00100000:2.0:1789136096.980793:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 86 00000100:00100000:2.0:1789136096.980813:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+9:13990:x1876044696106368:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136096.980864:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136096.980888:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630341 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.980920:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 10 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.980933:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 10 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.980944:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e000, rc 0) 00000100:00100000:2.0:1789136096.980990:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:13990:x1876044696106368:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 190us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.980998:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 86 00000100:00100000:0.0:1789136096.985624:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723366912 00000100:00100000:0.0:1789136096.985645:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723366912 00000100:00100000:0.0:1789136096.985760:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136096.985774:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c098780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723366912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136096.985919:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c098780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723366912:12345-0@lo:400:kworker.0 Request processed in 148us (8286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136096.985928:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136096.990072:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723366912:0@lo:400:kworker.0 00000100:00080000:2.0:1789136096.991037:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136096.991046:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136096.991050:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136096.994504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136096.994542:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106496 00000100:00100000:2.0:1789136096.994553:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106496 00000100:00100000:2.0:1789136096.994634:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:2.0:1789136096.994646:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:13990:x1876044696106496:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136096.995075:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:13990:x1876044696106496:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 429us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.995084:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 87 00000100:00100000:2.0:1789136097.004259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136097.004321:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106624 00000100:00100000:2.0:1789136097.004332:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106624 00000100:00100000:2.0:1789136097.004391:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:2.0:1789136097.004402:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:13990:x1876044696106624:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789136097.005010:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:13990:x1876044696106624:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 606us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136097.006397:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 88 00000100:00100000:1.0:1789136097.016972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136097.017022:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106752 00000100:00100000:1.0:1789136097.017034:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106752 00000100:00100000:1.0:1789136097.017107:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:1.0:1789136097.017126:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:14012:x1876044696106752:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789136097.017502:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:14012:x1876044696106752:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 375us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136097.017512:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 89 00000100:00100000:1.0:1789136097.038363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136097.039636:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696106880 00000100:00100000:3.0:1789136097.039651:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696106880 00000100:00100000:3.0:1789136097.039724:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 90 00000100:00100000:3.0:1789136097.039734:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f45ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:14012:x1876044696106880:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136097.040642:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f45ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:14012:x1876044696106880:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 903us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136097.040654:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 90 00000100:00100000:1.0:1789136097.070007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136097.070214:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107008 00000100:00100000:1.0:1789136097.070228:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107008 00000100:00100000:1.0:1789136097.070282:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:1.0:1789136097.070292:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1876044696107008:12345-192.168.204.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789136097.070921:0:15820:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4958cf40-dcb9-4063-84eb-d26b8ebcb17f@192.168.204.41@tcp t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:1.0:1789136097.070985:0:15820:0:(genops.c:1385:class_connect()) connect: client 4958cf40-dcb9-4063-84eb-d26b8ebcb17f, cookie 0x38eb79866bf973eb 00000004:00100000:1.0:1789136097.071173:0:15820:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789136097.071182:0:15820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789136097.091743:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789136097.091837:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:1.0:1789136097.151490:0:15820:0:(import.c:65:import_set_state_nolock()) ffff8ba04857f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136097.151609:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2362:x1876044696107008:12345-192.168.204.41@tcp:38:mount.lustre.0 Request processed in 81315us (81616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136097.151623:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:1.0:1789136097.163745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136097.163912:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107136 00000100:00100000:2.0:1789136097.163925:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107136 00000100:00100000:2.0:1789136097.164825:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:2.0:1789136097.164850:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:0:x1876044696107136:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789136097.164912:0:14834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789136097.165136:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136097.165799:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:0:x1876044696107136:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 960us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136097.165809:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:0.0:1789136097.181509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136097.181771:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107264 00000100:00100000:1.0:1789136097.181785:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107264 00000100:00100000:1.0:1789136097.181884:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:1.0:1789136097.181896:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107264:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789136097.181948:0:14835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789136097.182332:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107264:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 437us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136097.182358:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:1.0:1789136097.184295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136097.184491:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107392 00000100:00100000:0.0:1789136097.184502:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107392 00000100:00100000:0.0:1789136097.184559:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:0.0:1789136097.184570:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107392:12345-192.168.204.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789136097.184679:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107392:12345-192.168.204.41@tcp:40:mount.lustre.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136097.184687:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789136097.187474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136097.187581:0:16499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107520 00000100:00100000:1.0:1789136097.187592:0:16499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107520 00000100:00100000:1.0:1789136097.187647:0:16499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789136097.187656:0:16499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2362:x1876044696107520:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789136097.187695:0:16499:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4958cf40-dcb9-4063-84eb-d26b8ebcb17f@192.168.204.41@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1789136097.187798:0:16499:0:(genops.c:1385:class_connect()) connect: client 4958cf40-dcb9-4063-84eb-d26b8ebcb17f, cookie 0x38eb79866bf973f2 00002000:00100000:1.0:1789136097.187812:0:16499:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4958cf40-dcb9-4063-84eb-d26b8ebcb17f/ffff8ba07429e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789136097.187852:0:16499:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789136097.188588:0:16499:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789136097.188634:0:16499:0:(import.c:65:import_set_state_nolock()) ffff8ba074298000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136097.190191:0:16499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2362:x1876044696107520:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 2521us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136097.190767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136097.190831:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107648 00000100:00100000:0.0:1789136097.190850:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107648 00000100:00100000:0.0:1789136097.190906:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:0.0:1789136097.190915:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1876044696107648:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789136097.190970:0:15520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4958cf40-dcb9-4063-84eb-d26b8ebcb17f@192.168.204.41@tcp t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1789136097.191064:0:15520:0:(genops.c:1385:class_connect()) connect: client 4958cf40-dcb9-4063-84eb-d26b8ebcb17f, cookie 0x38eb79866bf973f9 00002000:00100000:0.0:1789136097.191079:0:15520:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4958cf40-dcb9-4063-84eb-d26b8ebcb17f/ffff8ba07435e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789136097.191091:0:15520:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789136097.191561:0:15520:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789136097.191601:0:15520:0:(import.c:65:import_set_state_nolock()) ffff8ba07435b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136097.191680:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2362:x1876044696107648:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 765us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136097.191690:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:1.0:1789136097.191795:0:16499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:2.0:1789136097.195320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136097.195368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136097.195413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136097.195524:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108032 00000100:00100000:3.0:1789136097.195537:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108032 00000100:00100000:3.0:1789136097.195616:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:3.0:1789136097.195628:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2363:x1876044696108032:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136097.195827:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2363:x1876044696108032:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 188us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136097.195837:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789136097.196581:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107904 00000100:00100000:0.0:1789136097.196600:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107904 00000100:00100000:0.0:1789136097.196756:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:0.0:1789136097.196797:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:2363:x1876044696107904:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136097.199457:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:2363:x1876044696107904:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 2661us (4026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136097.199473:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 91 00000100:00100000:1.0:1789136097.200932:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696107776 00000100:00100000:1.0:1789136097.200962:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696107776 00000100:00100000:1.0:1789136097.201066:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789136097.201079:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107776:12345-192.168.204.41@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789136097.210887:0:14836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9643us 00000004:00200000:2.0:1789136097.227174:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789136097.227434:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:13990:x1876044696107776:12345-192.168.204.41@tcp:33:mount.lustre.0 Request processed in 26349us (32120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136097.227454:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:3.0:1789136097.480593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136097.480802:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108160 00000100:00100000:2.0:1789136097.480815:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108160 00000100:00100000:2.0:1789136097.480968:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:2.0:1789136097.480982:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:14034:x1876044696108160:12345-192.168.204.41@tcp:101:mkdir.0 00010000:00010000:2.0:1789136097.481027:0:14834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136097.485719:0:14834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf97400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63036b expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.485808:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.485823:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.485850:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136097.486061:0:14834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789136097.486066:0:14834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789136097.486166:0:14834:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.486200:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0e800/0x38eb79866bf97400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63036b expref: 8 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.486220:0:14834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63036b expref: 7 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136097.486229:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:2.0:1789136097.486233:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136097.486238:0:14834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0fe00, rc 0) 00000100:00100000:2.0:1789136097.486441:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14034:x1876044696108160:12345-192.168.204.41@tcp:101:mkdir.0 Request processed in 5422us (5826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136097.486453:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000001:00100000:1.0:1789136097.586020:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4958cf40-dcb9-4063-84eb-d26b8ebcb17f 00010000:00010000:3.0:1789136097.741817:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136098.510320:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136098.510346:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723367424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136098.510431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136098.512470:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367424 00000100:00100000:1.0:1789136098.512483:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367424 00000100:00100000:1.0:1789136098.512582:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136098.512594:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723367424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136098.512651:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789136098.513320:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c09b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723367424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 728us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136098.513330:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789136098.513642:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136098.517073:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723367424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136098.765739:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136099.341454:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136099.789088:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136099.966573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136099.966694:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108288 00000100:00100000:1.0:1789136099.966744:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108288 00000100:00100000:1.0:1789136099.966827:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:1.0:1789136099.966839:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14087:x1876044696108288:12345-192.168.204.41@tcp:41:lfs.0 00000004:00000024:1.0:1789136099.966887:0:15820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789136099.966982:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14087:x1876044696108288:12345-192.168.204.41@tcp:41:lfs.0 Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.966989:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00080000:3.0:1789136099.967436:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136099.976665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136099.977116:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108416 00000100:00100000:2.0:1789136099.977139:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108416 00000100:00100000:2.0:1789136099.977259:0:15523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:2.0:1789136099.977270:0:15523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:14087:x1876044696108416:12345-192.168.204.41@tcp:13:lfs.0 00002000:00000024:2.0:1789136099.977311:0:15523:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789136099.977405:0:15523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:14087:x1876044696108416:12345-192.168.204.41@tcp:13:lfs.0 Request processed in 137us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136099.977413:0:15523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00080000:3.0:1789136099.984236:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136099.984391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136099.984481:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108544 00000100:00100000:2.0:1789136099.984500:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108544 00000100:00080000:3.0:1789136099.984854:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136099.984934:0:15523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789136099.984947:0:15523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:14087:x1876044696108544:12345-192.168.204.41@tcp:13:lfs.0 00002000:00000024:2.0:1789136099.984990:0:15523:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789136099.985080:0:15523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:14087:x1876044696108544:12345-192.168.204.41@tcp:13:lfs.0 Request processed in 138us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136099.985089:0:15523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:0.0:1789136100.434975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.435070:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108672 00000100:00100000:3.0:1789136100.435080:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108672 00000100:00100000:3.0:1789136100.435155:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:3.0:1789136100.435165:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+10:14119:x1876044696108672:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136100.435184:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136100.435204:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a4c00/0x38eb79866bf9740e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630372 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136100.435236:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a4c00/0x38eb79866bf9740e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630372 expref: 11 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136100.435247:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a4c00/0x38eb79866bf9740e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630372 expref: 11 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136100.435257:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a4c00, rc 0) 00000100:00100000:3.0:1789136100.435317:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696108672:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 154us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.435324:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 92 00000100:00100000:3.0:1789136100.452524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.452686:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108800 00000100:00100000:0.0:1789136100.452731:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108800 00000100:00100000:0.0:1789136100.452796:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:0.0:1789136100.452807:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696108800:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789136100.453132:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696108800:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 326us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136100.453140:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 93 00000100:00100000:0.0:1789136100.465839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.465958:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696108928 00000100:00100000:1.0:1789136100.465968:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696108928 00000100:00100000:1.0:1789136100.466035:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00100000:1.0:1789136100.466045:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696108928:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789136100.466330:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696108928:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 286us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.466339:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 94 00000100:00100000:1.0:1789136100.508580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.508758:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109056 00000100:00100000:3.0:1789136100.508770:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109056 00000100:00100000:3.0:1789136100.508840:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 95 00000100:00100000:3.0:1789136100.508851:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14126:x1876044696109056:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136100.509221:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14126:x1876044696109056:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 371us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.509230:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 95 00000100:00100000:3.0:1789136100.559993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.560229:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109184 00000100:00100000:0.0:1789136100.560241:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109184 00000100:00100000:0.0:1789136100.560293:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 96 00000100:00100000:0.0:1789136100.560301:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14126:x1876044696109184:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136100.560613:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14126:x1876044696109184:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136100.560622:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 96 00000100:00100000:0.0:1789136100.573336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.574292:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109312 00000100:00100000:1.0:1789136100.574304:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109312 00000100:00100000:1.0:1789136100.574370:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 97 00000100:00100000:1.0:1789136100.574398:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14119:x1876044696109312:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789136100.574418:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136100.574438:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0738a7200/0x38eb79866bf97415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63039c expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136100.574469:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0738a7200/0x38eb79866bf97415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63039c expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136100.574481:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0738a7200/0x38eb79866bf97415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63039c expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136100.574499:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7200, rc 0) 00000100:00100000:1.0:1789136100.574633:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14119:x1876044696109312:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 239us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.574640:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 97 00000100:00100000:1.0:1789136100.609366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.609518:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109440 00000100:00100000:3.0:1789136100.609529:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109440 00000100:00100000:3.0:1789136100.609585:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:3.0:1789136100.609596:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14119:x1876044696109440:12345-192.168.204.41@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789136100.609625:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789136100.609650:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789136100.609654:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789136100.609657:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789136100.609660:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789136100.611840:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14119:x1876044696109440:12345-192.168.204.41@tcp:256:mount.lustre.0 Request processed in 2236us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.611854:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 98 00000100:00100000:0.0:1789136100.615791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136100.615949:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109568 00000100:00100000:2.0:1789136100.615960:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109568 00000100:00100000:2.0:1789136100.616018:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00100000:2.0:1789136100.616028:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14119:x1876044696109568:12345-192.168.204.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136100.616048:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136100.616069:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303a3 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136100.616100:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136100.616131:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136100.616141:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f200, rc 0) 00000100:00100000:2.0:1789136100.616210:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14119:x1876044696109568:12345-192.168.204.41@tcp:101:mount.lustre.0 Request processed in 183us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136100.616217:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 99 00000100:00100000:1.0:1789136100.618815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.619070:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109696 00000100:00100000:3.0:1789136100.619080:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109696 00000100:00100000:3.0:1789136100.619136:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 100 00000100:00100000:3.0:1789136100.619145:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0741f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14119:x1876044696109696:12345-192.168.204.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789136100.621076:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0741f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14119:x1876044696109696:12345-192.168.204.41@tcp:501:mount.lustre.0 Request processed in 1922us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.621090:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 100 00000100:00100000:2.0:1789136100.631282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.631419:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109824 00000100:00100000:1.0:1789136100.631428:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109824 00000100:00100000:1.0:1789136100.631535:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 101 00000100:00100000:1.0:1789136100.631547:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14119:x1876044696109824:12345-192.168.204.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789136100.632131:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14119:x1876044696109824:12345-192.168.204.41@tcp:503:mount.lustre.0 Request processed in 571us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.632142:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 101 00000100:00100000:0.0:1789136100.635648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.636080:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696109952 00000100:00100000:3.0:1789136100.636090:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696109952 00000100:00100000:3.0:1789136100.636208:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 102 00000100:00100000:3.0:1789136100.636231:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14129:x1876044696109952:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136100.636513:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14129:x1876044696109952:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 282us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.636522:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 102 00000100:00100000:0.0:1789136100.642884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.645336:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110080 00000100:00100000:1.0:1789136100.645350:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110080 00000100:00100000:1.0:1789136100.645427:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:1.0:1789136100.645453:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14129:x1876044696110080:12345-192.168.204.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789136100.645752:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14129:x1876044696110080:12345-192.168.204.41@tcp:502:llog_process_th.0 Request processed in 300us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.645761:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 103 00000100:00100000:0.0:1789136100.658839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.658891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.658931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.658955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.659060:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110848 00000100:00100000:1.0:1789136100.659069:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110848 00000100:00100000:1.0:1789136100.659130:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110720 00000100:00100000:1.0:1789136100.659133:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110720 00000100:00100000:1.0:1789136100.659155:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789136100.659165:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2366:x1876044696110848:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136100.659243:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2366:x1876044696110848:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.659250:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789136100.659266:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:1.0:1789136100.659273:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2366:x1876044696110720:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136100.659296:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2366:x1876044696110720:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.659301:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:3.0:1789136100.660017:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110208 00000100:00100000:3.0:1789136100.660024:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110208 00000100:00100000:3.0:1789136100.660061:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110592 00000100:00100000:3.0:1789136100.660065:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110592 00000100:00100000:3.0:1789136100.660096:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:3.0:1789136100.660105:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2366:x1876044696110592:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136100.660156:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2366:x1876044696110592:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 53us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.660163:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:3.0:1789136100.660178:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:3.0:1789136100.660183:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1876044696110208:12345-192.168.204.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136100.660206:0:14834:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 23916e5f-ff83-468e-b110-c2c4ea0abd4d@192.168.204.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1789136100.660244:0:14834:0:(genops.c:1385:class_connect()) connect: client 23916e5f-ff83-468e-b110-c2c4ea0abd4d, cookie 0x38eb79866bf97423 00000004:00100000:3.0:1789136100.660282:0:14834:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789136100.660426:0:14834:0:(import.c:65:import_set_state_nolock()) ffff8ba07643a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136100.660455:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2362:x1876044696110208:12345-192.168.204.41@tcp:38:mount.lustre.0 Request processed in 270us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.660462:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:0.0:1789136100.678062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136100.678103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136100.678181:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110464 00000100:00100000:3.0:1789136100.678191:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110464 00000100:00100000:3.0:1789136100.678258:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110336 00000100:00100000:3.0:1789136100.678274:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110336 00000100:00100000:3.0:1789136100.678300:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:3.0:1789136100.678309:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+7:14119:x1876044696110464:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789136100.678354:0:14834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789136100.678420:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+7:14119:x1876044696110464:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136100.678427:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:3.0:1789136100.678444:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789136100.678450:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:0:x1876044696110336:12345-192.168.204.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789136100.678465:0:14834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789136100.678485:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:0:x1876044696110336:12345-192.168.204.41@tcp:41:mount.lustre.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00080000:2.0:1789136100.678600:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136100.679111:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:0.0:1789136100.698768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136100.698882:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696110976 00000100:00100000:2.0:1789136100.698892:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696110976 00000100:00100000:2.0:1789136100.698962:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789136100.698972:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14119:x1876044696110976:12345-192.168.204.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789136100.699060:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14119:x1876044696110976:12345-192.168.204.41@tcp:40:mount.lustre.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136100.699067:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789136100.717192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.717394:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111104 00000100:00100000:1.0:1789136100.717406:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111104 00000100:00100000:1.0:1789136100.717457:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:1.0:1789136100.717466:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1876044696111104:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789136100.717521:0:15521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 23916e5f-ff83-468e-b110-c2c4ea0abd4d@192.168.204.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1789136100.717555:0:15521:0:(genops.c:1385:class_connect()) connect: client 23916e5f-ff83-468e-b110-c2c4ea0abd4d, cookie 0x38eb79866bf9742a 00002000:00100000:1.0:1789136100.717568:0:15521:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 23916e5f-ff83-468e-b110-c2c4ea0abd4d/ffff8ba074299000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789136100.717594:0:15521:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789136100.718256:0:15521:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789136100.718291:0:15521:0:(import.c:65:import_set_state_nolock()) ffff8ba07429d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136100.718416:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2362:x1876044696111104:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 949us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136100.718427:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:1.0:1789136100.734224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136100.734343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136100.734789:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111360 00000100:00100000:2.0:1789136100.734801:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111360 00000100:00100000:2.0:1789136100.734862:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:2.0:1789136100.734873:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14119:x1876044696111360:12345-192.168.204.41@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789136100.735158:0:14837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789136100.735307:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14119:x1876044696111360:12345-192.168.204.41@tcp:33:mount.lustre.0 Request processed in 435us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136100.735316:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:0.0:1789136100.736912:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111232 00000100:00100000:0.0:1789136100.736936:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111232 00000100:00100000:0.0:1789136100.736987:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:0.0:1789136100.736995:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1876044696111232:12345-192.168.204.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789136100.737026:0:15520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 23916e5f-ff83-468e-b110-c2c4ea0abd4d@192.168.204.41@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:0.0:1789136100.737061:0:15520:0:(genops.c:1385:class_connect()) connect: client 23916e5f-ff83-468e-b110-c2c4ea0abd4d, cookie 0x38eb79866bf97431 00002000:00100000:0.0:1789136100.737077:0:15520:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 23916e5f-ff83-468e-b110-c2c4ea0abd4d/ffff8ba071cf6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789136100.737090:0:15520:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789136100.737180:0:15520:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789136100.737213:0:15520:0:(import.c:65:import_set_state_nolock()) ffff8ba071cf4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136100.737275:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2362:x1876044696111232:12345-192.168.204.41@tcp:8:mount.lustre.0 Request processed in 279us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136100.737282:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00010000:00010000:3.0:1789136100.813796:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136101.053739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136101.053858:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111488 00000100:00100000:0.0:1789136101.053869:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111488 00000100:00100000:0.0:1789136101.054038:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789136101.054048:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14151:x1876044696111488:12345-192.168.204.41@tcp:101:mkdir.0 00010000:00010000:0.0:1789136101.054071:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136101.054096:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf97438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303cd expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054165:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054181:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054194:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136101.054403:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789136101.054407:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789136101.054559:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054586:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf97438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 8 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054605:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 7 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136101.054614:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:0.0:1789136101.054617:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136101.054620:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140400, rc 0) 00000100:00100000:0.0:1789136101.054786:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+7:14151:x1876044696111488:12345-192.168.204.41@tcp:101:mkdir.0 Request processed in 738us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136101.054795:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00010000:00010000:1.0:1789136101.838853:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136102.093002:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136102.093025:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723367552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136102.093111:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136102.093216:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367552 00000100:00100000:1.0:1789136102.093227:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367552 00000100:00100000:1.0:1789136102.093295:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136102.093306:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723367552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136102.093344:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789136102.093395:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723367552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136102.093403:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136102.093441:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789136102.093463:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723367552:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789136102.093520:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136102.093797:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723367808:0@lo:400:kworker.0 00000100:00100000:1.0:1789136102.093829:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136102.093855:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136102.093861:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723367936:0@lo:400:kworker.0 00000100:00100000:1.0:1789136102.093885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136102.093909:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367808 00000100:00100000:1.0:1789136102.093925:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367808 00000100:00100000:1.0:1789136102.093962:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136102.093970:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723367808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136102.094008:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723367808:12345-0@lo:400:kworker.0 Request processed in 39us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136102.094014:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136102.094031:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367936 00000100:00100000:1.0:1789136102.094034:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367936 00000100:00100000:1.0:1789136102.094058:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136102.094064:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723367936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094286:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723368064:0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136102.094338:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789136102.094343:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723367680:0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136102.094385:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723368192:0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136102.094443:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368064 00000100:00100000:3.0:1789136102.094447:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368064 00000100:00100000:3.0:1789136102.094465:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368192 00000100:00100000:3.0:1789136102.094468:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368192 00000100:00100000:3.0:1789136102.094492:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136102.094498:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723368064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094532:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723368064:12345-0@lo:400:kworker.0 Request processed in 35us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136102.094539:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136102.094552:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136102.094558:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723368192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094583:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723368192:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136102.094589:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136102.094608:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723367680 00000100:00100000:3.0:1789136102.094611:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723367680 00000100:00100000:3.0:1789136102.094637:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789136102.094643:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:3313:x1876044723367680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094671:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:3313:x1876044723367680:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136102.094677:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1789136102.094723:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136102.094727:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136102.094985:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723367680:0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.094998:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723368192:0@lo:400:kworker.0 00000100:00100000:3.0:1789136102.095008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723368064:0@lo:400:kworker.0 00000100:00100000:1.0:1789136102.096522:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c2470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723367936:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136102.096540:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136102.096633:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723367936:0@lo:400:kworker.0 00000100:00100000:1.0:1789136102.096649:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723367808:0@lo:400:kworker.0 00000001:00100000:1.0:1789136102.170189:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4958cf40-dcb9-4063-84eb-d26b8ebcb17f 00000001:00100000:1.0:1789136102.170209:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 23916e5f-ff83-468e-b110-c2c4ea0abd4d 00000001:00100000:1.0:1789136102.227448:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 23916e5f-ff83-468e-b110-c2c4ea0abd4d 00000001:00100000:1.0:1789136102.227461:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4958cf40-dcb9-4063-84eb-d26b8ebcb17f 00000001:00100000:0.0:1789136102.712055:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 23916e5f-ff83-468e-b110-c2c4ea0abd4d 00010000:00010000:1.0:1789136102.860894:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136103.631249:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136103.631276:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723368320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136103.631360:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136103.631633:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368320 00000100:00100000:0.0:1789136103.631641:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368320 00000100:00100000:0.0:1789136103.631727:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789136103.631738:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723368320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136103.631775:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789136103.631834:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723368320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136103.631856:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136103.632065:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723368320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789136103.888996:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789136104.605650:0:16803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789136104.909095:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136105.861284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136105.861488:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111872 00000100:00100000:3.0:1789136105.861500:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111872 00000100:00100000:3.0:1789136105.861570:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112384 00000100:00100000:3.0:1789136105.861574:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112384 00000100:00100000:3.0:1789136105.861591:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112000 00000100:00100000:3.0:1789136105.861593:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112000 00000100:00100000:3.0:1789136105.861608:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112256 00000100:00100000:3.0:1789136105.861611:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112256 00000100:00100000:3.0:1789136105.861630:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:3.0:1789136105.861642:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696111872:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.861778:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696111872:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 138us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.861786:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:3.0:1789136105.861818:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789136105.861825:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696112384:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.861853:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696112384:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.861860:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:0.0:1789136105.862404:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111616 00000100:00100000:0.0:1789136105.862411:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111616 00000100:00100000:0.0:1789136105.862461:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 105 00000100:00100000:0.0:1789136105.862471:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:2365:x1876044696111616:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136105.862510:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:2365:x1876044696111616:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 41us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136105.862517:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 105 00000100:00100000:3.0:1789136105.862623:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:3.0:1789136105.862639:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696112000:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.862667:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696112000:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 31us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.863280:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:3.0:1789136105.863302:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:3.0:1789136105.863312:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696112256:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.863348:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696112256:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 39us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.863354:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:3.0:1789136105.863375:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112128 00000100:00100000:3.0:1789136105.863379:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112128 00000100:00100000:3.0:1789136105.863413:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696111744 00000100:00100000:3.0:1789136105.863416:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696111744 00000100:00100000:3.0:1789136105.863437:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:3.0:1789136105.863443:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2365:x1876044696112128:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.863474:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2365:x1876044696112128:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 32us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.863481:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:3.0:1789136105.863494:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:3.0:1789136105.863500:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2365:x1876044696111744:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:3.0:1789136105.863523:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2365:x1876044696111744:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 24us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136105.863529:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00080000:3.0:1789136105.863556:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136105.863568:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136105.863570:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136105.948898:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136106.957945:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136107.213245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723368448:0@lo:400:kworker.0 00000100:00100000:1.0:1789136107.213333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136107.213404:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368448 00000100:00100000:1.0:1789136107.213410:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368448 00000100:00100000:1.0:1789136107.213465:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789136107.213474:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3312:x1876044723368448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136107.213526:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3312:x1876044723368448:12345-0@lo:400:kworker.0 Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136107.213774:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789136107.213962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723368576:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.213999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136107.214039:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368576 00000100:00100000:0.0:1789136107.214043:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368576 00000100:00100000:0.0:1789136107.214087:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136107.214095:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723368576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214133:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723368576:12345-0@lo:400:kworker.0 Request processed in 39us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136107.214140:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789136107.214157:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136107.214188:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723368576:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214225:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723368704:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214249:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136107.214289:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368704 00000100:00100000:0.0:1789136107.214293:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368704 00000100:00100000:0.0:1789136107.214323:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136107.214329:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723368704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214377:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723368704:12345-0@lo:400:kworker.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136107.214384:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789136107.214401:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136107.214417:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723368704:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214450:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723368832:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136107.214505:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368832 00000100:00100000:0.0:1789136107.214509:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368832 00000100:00100000:0.0:1789136107.214535:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136107.214541:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723368832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214574:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723368832:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136107.214580:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136107.214606:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723368832:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214630:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136107.214636:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723368960:0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136107.214694:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723368960 00000100:00100000:0.0:1789136107.214697:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723368960 00000100:00100000:0.0:1789136107.214745:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789136107.214750:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723368960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136107.214783:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723368960:12345-0@lo:400:kworker.0 Request processed in 33us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136107.214789:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136107.214915:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723368448:0@lo:400:kworker.0 00000100:00080000:2.0:1789136107.215386:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136107.215447:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723368960:0@lo:400:kworker.0 00000100:00100000:2.0:1789136107.215476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723369088:0@lo:400:kworker.0 00000100:00100000:2.0:1789136107.215508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136107.215548:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369088 00000100:00100000:2.0:1789136107.215552:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369088 00000100:00100000:2.0:1789136107.215584:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136107.215590:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723369088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136107.215625:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723369088:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136107.215632:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789136107.215646:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136107.215677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723369088:0@lo:400:kworker.0 00000100:00100000:3.0:1789136107.217455:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136107.217472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723369216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136107.217529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136107.218824:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369216 00000100:00100000:3.0:1789136107.218835:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369216 00000100:00100000:3.0:1789136107.218895:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136107.218904:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723369216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136107.218947:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789136107.219033:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723369216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136107.219041:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136107.219098:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723369216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789136107.995968:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136108.753690:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136108.753733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723369344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136108.753824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136108.754570:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369344 00000100:00100000:0.0:1789136108.754579:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369344 00000100:00100000:0.0:1789136108.754642:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136108.754652:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723369344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136108.754694:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789136108.754776:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723369344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136108.754783:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136108.778462:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c39a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723369344:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136109.005142:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789136109.471158:0:16953:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe18666f40 20000000:00000080:0.0:1789136109.471177:0:16953:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b9f476b9000 uarg=0000000000000000 20000000:01000000:0.0:1789136109.471214:0:16953:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789136109.471219:0:16953:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789136109.471224:0:16953:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789136109.472287:0:16954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789136109.472531:0:16953:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789136109.480457:0:16953:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789136109.480491:0:16953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480511:0:16953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97136 expref: 18 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480519:0:16953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97183 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480526:0:16953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480536:0:16953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480563:0:16953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480570:0:16953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480651:0:16953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 12 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.480669:0:16953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 12 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.480684:0:16953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369472:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789136109.481309:0:16953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.481333:0:16953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.481343:0:16953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369600:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789136109.481374:0:16953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.481382:0:16953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.481391:0:16953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369728:0@lo:104: 00000100:00100000:0.0:1789136109.481424:0:16953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136109.481463:0:16953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 18 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.481472:0:16953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 18 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.481480:0:16953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369856:0@lo:104: 00000100:00100000:0.0:1789136109.481498:0:16953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136109.481519:0:16953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 18 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.481527:0:16953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 18 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.481534:0:16953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369984:0@lo:104: 00000100:00100000:0.0:1789136109.481551:0:16953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136109.481558:0:16953:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600d1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136109.482081:0:14816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789136109.482095:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369728 00000100:00100000:1.0:1789136109.482101:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369728 00000100:00100000:1.0:1789136109.482135:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369856 00000100:00100000:1.0:1789136109.482137:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369856 00000100:00100000:1.0:1789136109.482145:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723369984 00000100:00100000:1.0:1789136109.482147:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723369984 00000100:00100000:1.0:1789136109.482158:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136109.482165:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+5:16953:x1876044723369728:12345-0@lo:104: 00010000:00010000:1.0:1789136109.482180:0:14816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482239:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136109.482245:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+5:16953:x1876044723369728:12345-0@lo:104: Request processed in 80us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.482252:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136109.482267:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136109.482273:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+4:16953:x1876044723369856:12345-0@lo:104: 00010000:00010000:1.0:1789136109.482281:0:14816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482342:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136109.482347:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+4:16953:x1876044723369856:12345-0@lo:104: Request processed in 74us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.482353:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136109.482365:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136109.482372:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba076441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+3:16953:x1876044723369984:12345-0@lo:104: 00010000:00010000:1.0:1789136109.482379:0:14816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482406:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789136109.482411:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba076441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2dc02be1-e923-45bb-814e-7c82b120b447+3:16953:x1876044723369984:12345-0@lo:104: Request processed in 40us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.482416:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789136109.482453:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789136109.482458:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482465:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789136109.482470:0:14822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482479:0:14822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136109.482487:0:14822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136109.482493:0:14822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789136109.482524:0:14822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482531:0:14822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136109.482550:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482557:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba0738a7600/0x38eb79866bf972b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf972be expref: -99 pid: 16237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482569:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136109.482572:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482577:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5400 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789136109.482581:0:14822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482587:0:14822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136109.482594:0:14822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136109.482599:0:14822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789136109.482620:0:14822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482626:0:14822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136109.482640:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482656:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5400/0x38eb79866bf97183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9718a expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482666:0:14822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136109.482669:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482675:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1adec20) 10000000:00010000:1.0:1789136109.482678:0:14822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482684:0:14822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136109.482690:0:14822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136109.482695:0:14822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789136109.482928:0:14822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482935:0:14822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136109.482942:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482948:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.141@tcp lock: ffff8ba07c1a5200/0x38eb79866bf97136 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x38eb79866bf9713d expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.482960:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136109.482967:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136109.482969:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136109.482976:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136109.482995:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c2452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723370112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136109.483023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136109.483060:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723370240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136109.483078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136109.483093:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136109.483098:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723370368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136109.483116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136109.483140:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370112 00000100:00100000:1.0:1789136109.483144:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370112 00010000:00010000:1.0:1789136109.483161:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 19 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136109.483174:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370240 00000100:00100000:1.0:1789136109.483176:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370240 00010000:00010000:1.0:1789136109.483183:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 20 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136109.483191:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370368 00000100:00100000:1.0:1789136109.483193:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370368 00010000:00010000:1.0:1789136109.483200:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 21 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136109.483211:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136109.483216:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+21:3312:x1876044723370112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136109.483226:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136109.483231:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 21 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483245:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 21 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483260:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136109.483287:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+21:3312:x1876044723370112:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.483294:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136109.483308:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136109.483314:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+20:3313:x1876044723370240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136109.483339:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136109.483344:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 20 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483353:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 20 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483362:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136109.483387:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+20:3313:x1876044723370240:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.483394:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136109.483407:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136109.483412:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3313:x1876044723370368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136109.483419:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136109.483423:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 19 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483431:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 19 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.483445:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136109.483464:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3313:x1876044723370368:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.483470:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136109.483524:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c2452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723370112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136109.483543:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723370368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136109.483549:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2dc02be1-e923-45bb-814e-7c82b120b447:3313:1876044723370240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136109.485329:0:16953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba049141c00/0x38eb79866bf972be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf972b7 expref: 18 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.485349:0:16953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369728:0@lo:104: 00010000:00010000:0.0:1789136109.485363:0:16953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba086377200/0x38eb79866bf9718a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf97183 expref: 17 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.485373:0:16953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369856:0@lo:104: 00010000:00010000:0.0:1789136109.485383:0:16953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba0738a7c00/0x38eb79866bf9713d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x38eb79866bf97136 expref: 16 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136109.485390:0:16953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369984:0@lo:104: 00010000:00010000:2.0:1789136109.485650:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136109.490211:0:16953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369472:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789136109.490243:0:16953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072e9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16953:1876044723369600:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789136109.490288:0:16953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136109.492266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136109.492365:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112512 00000100:00100000:2.0:1789136109.492374:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112512 00010000:00010000:2.0:1789136109.492413:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136109.492453:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789136109.492464:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:2364:x1876044696112512:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136109.492477:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136109.492483:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136109.492510:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136109.492529:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf9741c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303a3 expref: 13 pid: 14827 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136109.492545:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136109.492600:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:2364:x1876044696112512:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136109.492619:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789136109.495635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136109.495744:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112640 00000100:00100000:1.0:1789136109.495754:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112640 00010000:00010000:1.0:1789136109.495788:0:14819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136109.495822:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:1.0:1789136109.495831:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:2363:x1876044696112640:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136109.495844:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136109.495849:0:14819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495862:0:14819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495881:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba085a0e000/0x38eb79866bf973e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630341 expref: 12 pid: 14826 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495896:0:14819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495918:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495934:0:14819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495942:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495949:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495956:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495961:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136109.495965:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495972:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495988:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136109.495999:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136109.496047:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:2363:x1876044696112640:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 216us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.496054:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00010000:00010000:0.0:1789136109.496206:0:16953:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.496215:0:16953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136109.496221:0:16953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ba049141000/0x38eb79866bf97446 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136109.585939:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136110.029493:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136110.963106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136110.963286:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113024 00000100:00100000:2.0:1789136110.963294:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113024 00000100:00100000:2.0:1789136110.963346:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113536 00000100:00100000:2.0:1789136110.963350:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113536 00000100:00100000:2.0:1789136110.963362:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113152 00000100:00100000:2.0:1789136110.963364:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113152 00000100:00100000:2.0:1789136110.963377:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113408 00000100:00100000:2.0:1789136110.963379:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113408 00000100:00100000:2.0:1789136110.963393:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:2.0:1789136110.963402:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696113024:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.963818:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112768 00000100:00100000:0.0:1789136110.963823:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112768 00000100:00100000:0.0:1789136110.963853:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 107 00000100:00100000:0.0:1789136110.963861:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:2364:x1876044696112768:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.963934:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:2364:x1876044696112768:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 73us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.963941:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 107 00000100:00100000:0.0:1789136110.964001:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:0.0:1789136110.964009:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2364:x1876044696113536:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.964035:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2364:x1876044696113536:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.964042:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:0.0:1789136110.964055:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789136110.964071:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696113152:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.964098:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696113152:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.964104:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789136110.964116:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:0.0:1789136110.964122:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2364:x1876044696113408:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.964144:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2364:x1876044696113408:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 22us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.964149:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:0.0:1789136110.964167:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113280 00000100:00100000:0.0:1789136110.964170:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113280 00000100:00100000:0.0:1789136110.964195:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696112896 00000100:00100000:0.0:1789136110.964198:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696112896 00000100:00100000:0.0:1789136110.964216:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:0.0:1789136110.964222:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2364:x1876044696113280:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.964248:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2364:x1876044696113280:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 27us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.964255:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:0.0:1789136110.964268:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:0.0:1789136110.964274:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2364:x1876044696112896:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136110.964299:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2364:x1876044696112896:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 25us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136110.964305:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00080000:0.0:1789136110.964341:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136110.964352:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136110.964354:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136110.964643:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696113024:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 1241us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136110.964656:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00010000:00010000:1.0:1789136111.057212:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789136111.325169:0:14830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136111.325176:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba071cf7000 from 13 10000000:01000000:2.0:1789136111.325181:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136111.325225:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.325236:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.325246:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.325272:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.325340:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.325390:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136111.326239:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370496 00000100:00100000:1.0:1789136111.326249:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370496 00000100:00100000:1.0:1789136111.326298:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789136111.326308:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+16:14830:x1876044723370496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136111.326324:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136111.326340:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba0738a6c00/0x38eb79866bf97454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9744d expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136111.326362:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba0738a6c00/0x38eb79866bf97454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9744d expref: 17 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136111.326371:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba0738a6c00/0x38eb79866bf97454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9744d expref: 17 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136111.326380:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6c00, rc 0) 00000100:00100000:1.0:1789136111.329394:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+17:14830:x1876044723370496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3079us (4045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136111.329407:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789136111.331749:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.331780:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97454 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.331793:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97454 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.331884:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.331951:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.331994:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370624 00000100:00100000:2.0:1789136111.331999:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370624 00000100:00100000:2.0:1789136111.332043:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136111.332069:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723370624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.332341:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723370624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.332349:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136111.332400:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.332430:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.332459:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.332499:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.332518:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370752 00000100:00100000:2.0:1789136111.332522:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370752 00000100:00100000:2.0:1789136111.332540:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789136111.332547:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723370752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.332689:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723370752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.332696:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789136111.332748:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0600c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.332760:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136111.337360:0:17019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789136111.337423:0:14830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789136111.337446:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136111.337459:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97454 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.337470:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0e000/0x38eb79866bf9744d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97454 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136111.337509:0:14830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136111.337511:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba085f47800 from 13 10000000:01000000:2.0:1789136111.337514:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136111.337552:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.337559:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.337582:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.337607:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.337674:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.340883:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba05bff03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.340912:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723370880 00000100:00100000:2.0:1789136111.340919:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723370880 00000100:00100000:2.0:1789136111.340969:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789136111.340977:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+17:14830:x1876044723370880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.340996:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136111.341013:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf97462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf9745b expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.341040:0:14827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf97462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf9745b expref: 18 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.341052:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0f200/0x38eb79866bf97462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf9745b expref: 18 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.341074:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0f200, rc 0) 00000100:00100000:2.0:1789136111.341160:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723370880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (3485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.341167:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789136111.341233:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723370880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.341252:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97462 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.341261:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97462 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.341328:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.341361:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.341378:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287540 going to sleep for 11 seconds 00000100:00100000:1.0:1789136111.342110:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371008 00000100:00100000:1.0:1789136111.342116:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371008 00000100:00100000:1.0:1789136111.342151:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789136111.342160:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723371008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136111.349041:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723371008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6872us (7669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136111.349058:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789136111.350861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136111.350909:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113664 00000100:00100000:2.0:1789136111.350916:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113664 00000100:00100000:2.0:1789136111.350963:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:2.0:1789136111.350973:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+11:14005:x1876044696113664:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.350992:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136111.351010:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf97469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303d4 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.351040:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf97469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303d4 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.351066:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba085a0e800/0x38eb79866bf97469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303d4 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.351076:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba085a0e800, rc 0) 00000100:00100000:2.0:1789136111.351132:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072ed8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696113664:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 161us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.351138:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 113 00000100:00100000:2.0:1789136111.351300:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.351353:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.351402:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.351445:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba051287540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.351458:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371136 00000100:00100000:2.0:1789136111.351462:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371136 00000100:00100000:2.0:1789136111.351502:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789136111.351509:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723371136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.351718:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723371136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.351725:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789136111.351764:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136111.352354:0:17021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789136111.352406:0:14830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789136111.352423:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136111.352432:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97462 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352453:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba085a0fc00/0x38eb79866bf9745b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97462 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136111.352463:0:14830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136111.352466:0:14830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ba073580000 from 13 10000000:01000000:2.0:1789136111.352469:0:14830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136111.352492:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352500:0:14830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352508:0:14830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.352524:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.352557:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.352588:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.352603:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371264 00000100:00100000:2.0:1789136111.352607:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371264 00000100:00100000:2.0:1789136111.352632:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789136111.352639:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+18:14830:x1876044723371264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.352648:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136111.352659:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba072936000/0x38eb79866bf97477 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x38eb79866bf97470 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352676:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba072936000/0x38eb79866bf97477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x38eb79866bf97470 expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352697:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba072936000/0x38eb79866bf97477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x38eb79866bf97470 expref: 19 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352724:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936000, rc 0) 00000100:00100000:2.0:1789136111.352757:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723371264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.352763:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789136111.352796:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136111.352807:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97477 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136111.352817:0:14830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x38eb79866bf97477 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136111.352855:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.352879:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.352891:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.352901:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371392 00000100:00100000:2.0:1789136111.352904:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371392 00000100:00100000:2.0:1789136111.352924:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789136111.352937:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723371392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.353138:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723371392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.353144:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789136111.353171:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.353202:0:14830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.353234:0:14830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136111.353246:0:14830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba047d5de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136111.353256:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371520 00000100:00100000:2.0:1789136111.353259:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371520 00000100:00100000:2.0:1789136111.353278:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789136111.353283:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723371520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.357893:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2dc02be1-e923-45bb-814e-7c82b120b447+19:14830:x1876044723371520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4602us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.358129:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789136111.358230:0:14830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba072eec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2dc02be1-e923-45bb-814e-7c82b120b447:14830:1876044723371520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136111.360440:0:17022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789136111.360925:0:14830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789136111.360948:0:14830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136111.360960:0:14830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97477 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136111.360971:0:14830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.141@tcp lock: ffff8ba072937800/0x38eb79866bf97470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x38eb79866bf97477 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136111.372026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136111.374596:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113792 00000100:00100000:2.0:1789136111.374609:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113792 00000100:00100000:2.0:1789136111.375518:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:2.0:1789136111.375533:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696113792:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.376492:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696113792:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 960us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.376504:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 118 00000100:00100000:0.0:1789136111.400369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136111.400437:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696113920 00000100:00100000:0.0:1789136111.400447:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696113920 00000100:00100000:0.0:1789136111.400512:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:0.0:1789136111.400522:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696113920:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136111.401054:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696113920:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 532us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136111.401063:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 119 00000100:00100000:2.0:1789136111.416771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136111.417544:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114048 00000100:00100000:3.0:1789136111.417555:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114048 00000100:00100000:3.0:1789136111.417627:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:3.0:1789136111.417638:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+12:14005:x1876044696114048:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136111.417683:0:14826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136111.417731:0:14826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf9747e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303db expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136111.417762:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf9747e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303db expref: 13 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136111.417775:0:14826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ba07c1a5800/0x38eb79866bf9747e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303db expref: 13 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136111.417784:0:14826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5800, rc 0) 00000100:00100000:3.0:1789136111.417841:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14005:x1876044696114048:12345-192.168.204.41@tcp:101:ll_cfg_requeue.0 Request processed in 205us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136111.417848:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 120 00000100:00100000:3.0:1789136111.420943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136111.421067:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114176 00000100:00100000:1.0:1789136111.421077:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114176 00000100:00100000:1.0:1789136111.421116:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:1.0:1789136111.421138:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14005:x1876044696114176:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136111.421441:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14005:x1876044696114176:12345-192.168.204.41@tcp:501:ll_cfg_requeue.0 Request processed in 303us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136111.421450:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 121 00000100:00100000:3.0:1789136111.424396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136111.424477:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114304 00000100:00100000:2.0:1789136111.424492:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114304 00000100:00100000:2.0:1789136111.424541:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 122 00000100:00100000:2.0:1789136111.424551:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14005:x1876044696114304:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136111.424801:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:14005:x1876044696114304:12345-192.168.204.41@tcp:503:ll_cfg_requeue.0 Request processed in 251us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136111.424815:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 122 00010000:00010000:3.0:1789136112.077447:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136112.344002:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba073c8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723371648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136112.344075:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.344121:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723372160:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.344147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.344171:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789136112.344191:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723371776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.345147:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723372288:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345175:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.345203:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c2452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723371904:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.345246:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723372416:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345271:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.345291:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136112.345297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723372032:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.345346:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371648 00000100:00100000:1.0:1789136112.345353:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371648 00000100:00100000:1.0:1789136112.345402:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136112.345411:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723371648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136112.345463:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789136112.345520:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723371648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.345527:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136112.345560:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723372160 00000100:00100000:1.0:1789136112.345564:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723372160 00000100:00100000:1.0:1789136112.345588:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723372288 00000100:00100000:1.0:1789136112.345591:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723372288 00000100:00100000:1.0:1789136112.345603:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723372416 00000100:00100000:1.0:1789136112.345605:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723372416 00000100:00100000:1.0:1789136112.345618:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136112.345623:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723372160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.345656:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723372160:12345-0@lo:400:kworker.0 Request processed in 33us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.345662:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136112.346066:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136112.346074:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723372288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.346107:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876044723372288:12345-0@lo:400:kworker.0 Request processed in 33us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.346113:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136112.346124:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136112.346130:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723372416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.346173:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044723372416:12345-0@lo:400:kworker.0 Request processed in 43us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.346179:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136112.346433:0:14826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371776 00000100:00100000:1.0:1789136112.346438:0:14826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371776 00000100:00100000:3.0:1789136112.347000:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c245680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044723372416:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347168:0:14826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789136112.347179:0:14826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723371776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347220:0:14826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2dc02be1-e923-45bb-814e-7c82b120b447+19:3311:x1876044723371776:12345-0@lo:400:kworker.0 Request processed in 44us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.347227:0:14826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789136112.347257:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723371904 00000100:00100000:1.0:1789136112.347261:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723371904 00000100:00100000:1.0:1789136112.347289:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723372032 00000100:00100000:1.0:1789136112.347292:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723372032 00000100:00100000:1.0:1789136112.347309:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136112.347315:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723371904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347353:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072e9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723371904:12345-0@lo:400:kworker.0 Request processed in 38us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.347359:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136112.347370:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136112.347376:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723372032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347404:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044723372032:12345-0@lo:400:kworker.0 Request processed in 28us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.347410:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789136112.347431:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136112.347435:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136112.347438:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136112.347516:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c247c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723372032:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347527:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c2452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1876044723371904:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347567:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2dc02be1-e923-45bb-814e-7c82b120b447:3311:1876044723371776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347579:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c246d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1876044723372288:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.347607:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba073c8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723371648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136112.347618:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c244780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723372160:0@lo:400:kworker.0 00010000:00010000:1.0:1789136113.100972:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136113.371566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.372022:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114432 00000100:00100000:1.0:1789136113.372032:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114432 00000100:00100000:1.0:1789136113.372116:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:1.0:1789136113.372128:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:14662:x1876044696114432:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136113.372153:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.372178:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf97485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303e2 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372245:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372260:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372274:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372290:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372297:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.372304:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789136113.373115:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789136113.373346:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf9749a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373360:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf9749a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373370:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf9749a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.373455:0:15820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789136113.373460:0:15820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136113.373566:0:15820:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf9749a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373578:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373586:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373592:0:15820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373598:0:15820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.373602:0:15820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373610:0:15820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373623:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:1.0:1789136113.373633:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.373639:0:15820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.373645:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9748c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374498:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374506:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374513:0:15820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374519:0:15820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.374522:0:15820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374529:0:15820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374554:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ba069d75d00) 00010000:00010000:1.0:1789136113.374557:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.374561:0:15820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374567:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97493 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374611:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf97485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303e2 expref: 8 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374658:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7800/0x38eb79866bf9749a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303e2 expref: 7 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.374672:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:1.0:1789136113.374675:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136113.374677:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7800, rc 0) 00000100:00100000:1.0:1789136113.375197:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14662:x1876044696114432:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 3069us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.375207:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:3.0:1789136113.383060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.383293:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114688 00000100:00100000:1.0:1789136113.383304:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114688 00000100:00100000:1.0:1789136113.383364:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:1.0:1789136113.383374:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14662:x1876044696114688:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136113.383397:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.383418:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303e9 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383502:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383517:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383529:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383597:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383618:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.383627:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.387386:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf974b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.387409:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf974b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.387421:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf974b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.387434:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789136113.394281:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394300:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394308:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394314:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7c00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.394319:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394327:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394364:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ba069d75400) 00010000:00010000:1.0:1789136113.394367:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.394373:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394379:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394396:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394403:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394409:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394414:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.394417:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394422:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394429:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.394432:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.394435:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.394441:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.401614:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303e9 expref: 10 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.401651:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7000/0x38eb79866bf974b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303e9 expref: 9 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.401668:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba069d75800) 00010000:00010000:1.0:1789136113.401671:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.401675:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7000, rc 0) 00000100:00100000:1.0:1789136113.402359:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14662:x1876044696114688:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 18982us (19305us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789136113.402369:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:3.0:1789136113.417282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.417407:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114816 00000100:00100000:1.0:1789136113.417425:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114816 00000100:00100000:1.0:1789136113.417510:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:1.0:1789136113.417522:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14662:x1876044696114816:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789136113.417845:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14662:x1876044696114816:12345-192.168.204.41@tcp:59:lhsmtool_posix.0 Request processed in 325us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.417852:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:2.0:1789136113.462502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136113.463968:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696114944 00000100:00100000:0.0:1789136113.463985:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696114944 00000100:00100000:0.0:1789136113.464075:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:0.0:1789136113.464088:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14668:x1876044696114944:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789136113.464114:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136113.464154:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141a00/0x38eb79866bf974c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303f0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464242:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464473:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464490:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464509:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464517:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.464524:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465509:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465523:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465543:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465550:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789136113.465554:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465564:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465581:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:0.0:1789136113.465591:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136113.465597:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465603:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf974cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465621:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465627:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465633:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465639:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789136113.465642:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465648:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465656:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba06ca52e00) 00010000:00010000:0.0:1789136113.465659:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136113.465662:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.465668:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf974d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.467387:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141a00/0x38eb79866bf974c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303f0 expref: 10 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.467423:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:0.0:1789136113.467425:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136113.467431:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141a00/0x38eb79866bf974c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303f0 expref: 10 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.467449:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049141a00, rc 0) 00000100:00100000:0.0:1789136113.467559:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14668:x1876044696114944:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 3473us (5072us total) trans 0 rc 301/301 00000100:00100000:0.0:1789136113.467569:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:3.0:1789136113.477457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.478202:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115072 00000100:00100000:1.0:1789136113.478216:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115072 00000100:00100000:1.0:1789136113.478301:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789136113.478314:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14668:x1876044696115072:12345-192.168.204.41@tcp:700:lfs.0 00000100:00100000:1.0:1789136113.478431:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14668:x1876044696115072:12345-192.168.204.41@tcp:700:lfs.0 Request processed in 119us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.478451:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:3.0:1789136113.487330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.489490:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115328 00000100:00100000:1.0:1789136113.489510:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115328 00000100:00100000:1.0:1789136113.489617:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:1.0:1789136113.489631:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14668:x1876044696115328:12345-192.168.204.41@tcp:36:lfs.0 00010000:00010000:1.0:1789136113.489972:0:14834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136113.490010:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba085a0fe00/0x38eb79866bf97407 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63036b expref: 9 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.490039:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:1.0:1789136113.490046:0:14834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136113.490519:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.490551:0:14834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 5 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.490561:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.490605:0:14834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 5 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.490622:0:14834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 5 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136113.490642:0:14834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0497a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14834:1876044723372544:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789136113.494116:0:14834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07359b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136113.495146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.495459:0:14834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0497a92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14834:1876044723372544:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789136113.495493:0:14834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136113.496163:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115456 00000100:00100000:0.0:1789136113.496174:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115456 00010000:00010000:0.0:1789136113.496254:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 6 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136113.496298:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:0.0:1789136113.496308:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2364:x1876044696115456:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136113.496326:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136113.496333:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 6 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496346:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 6 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496375:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf9743f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303cd expref: 6 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496418:0:14820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:0.0:1789136113.496425:0:14820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496435:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496444:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.496480:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136113.496564:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2364:x1876044696115456:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 256us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136113.496572:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00080000:2.0:1789136113.497034:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789136113.497290:0:14834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.497300:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.497345:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.497356:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.497366:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136113.503423:0:14834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789136113.503450:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503463:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503472:0:14834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503479:0:14834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789136113.503485:0:14834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503495:0:14834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503517:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba0486c1e00) 00010000:00010000:3.0:1789136113.503521:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136113.503527:0:14834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.503560:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf974d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136113.503588:0:14834:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c4316c41 reply state 0000000043a34bbe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136113.503599:0:14834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136113.503766:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+10:14668:x1876044696115328:12345-192.168.204.41@tcp:36:lfs.0 Request processed in 14133us (16448us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789136113.503777:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00010000:00010000:3.0:1789136113.510501:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510527:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510547:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510554:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789136113.510559:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510568:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510586:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba05c659900) 00010000:00010000:3.0:1789136113.510590:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136113.510596:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.510626:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf974e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136113.615456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.616030:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115584 00000100:00100000:1.0:1789136113.616043:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115584 00000100:00100000:1.0:1789136113.616124:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:1.0:1789136113.616136:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:14676:x1876044696115584:12345-192.168.204.41@tcp:101:lctl.0 00010000:00010000:1.0:1789136113.616167:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.616196:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303f7 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616295:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616312:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616325:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.616406:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789136113.616411:0:14833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136113.616503:0:14833:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616550:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303f7 expref: 11 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616588:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7c00/0x38eb79866bf974ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303f7 expref: 10 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.616600:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.616603:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136113.616609:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7c00, rc 0) 00000100:00100000:1.0:1789136113.617193:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+10:14676:x1876044696115584:12345-192.168.204.41@tcp:101:lctl.0 Request processed in 1057us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.617204:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:2.0:1789136113.646211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.646336:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115712 00000100:00100000:1.0:1789136113.646349:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115712 00000100:00100000:1.0:1789136113.646429:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:1.0:1789136113.646443:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:14677:x1876044696115712:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789136113.646472:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.646504:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a6303fe expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.646602:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf974fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.646619:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf974fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.646633:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf974fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.646785:0:15820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789136113.646810:0:15820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136113.646847:0:15820:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf974fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.646994:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf974f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303fe expref: 7 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.647018:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6e00/0x38eb79866bf974fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a6303fe expref: 6 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.647028:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.647031:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136113.647036:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6e00, rc 0) 00000100:00100000:1.0:1789136113.651546:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14677:x1876044696115712:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 5072us (5315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.651565:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 21 00000100:00100000:3.0:1789136113.657293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.657446:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696115840 00000100:00100000:1.0:1789136113.657461:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696115840 00000100:00100000:1.0:1789136113.657562:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:1.0:1789136113.657575:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:14677:x1876044696115840:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789136113.657601:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.657632:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97503 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630405 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657832:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657852:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657958:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657979:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657986:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.657993:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.658125:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.658134:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.658141:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.658188:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789136113.658192:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136113.658219:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.658233:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659153:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659186:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659193:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.659199:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659208:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659226:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.659230:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.659236:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659255:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9750a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659274:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659280:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659286:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659290:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.659293:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659309:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659318:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba069d75d00) 00010000:00010000:1.0:1789136113.659321:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.659324:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659330:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97511 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659383:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf97503 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630405 expref: 8 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659400:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630405 expref: 7 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.659408:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba069d75300) 00010000:00010000:1.0:1789136113.659410:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136113.659412:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6400, rc 0) 00000100:00100000:1.0:1789136113.659502:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+7:14677:x1876044696115840:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1929us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136113.659513:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 22 00000100:00100000:3.0:1789136113.672294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.674975:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696116096 00000100:00100000:1.0:1789136113.674995:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696116096 00000040:00080000:0.0:1789136113.678173:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789136113.679358:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:2.0:1789136113.679374:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+7:14677:x1876044696116096:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:2.0:1789136113.679402:0:14834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136113.679430:0:14834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf9751f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63040c expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136113.679597:0:14834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789136113.680029:0:14834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf9751f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63040c expref: 9 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.680048:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:2.0:1789136113.680051:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789136113.680058:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937c00/0x38eb79866bf9751f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63040c expref: 9 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.680075:0:14834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937c00, rc 0) 00000100:00100000:2.0:1789136113.680166:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+8:14677:x1876044696116096:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 796us (7888us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789136113.680175:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 23 00000100:00100000:2.0:1789136113.689610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.692950:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696116352 00000100:00100000:1.0:1789136113.692972:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696116352 00000100:00100000:1.0:1789136113.693150:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:1.0:1789136113.693165:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+8:14677:x1876044696116352:12345-192.168.204.41@tcp:36:lfs.0 00010000:00010000:1.0:1789136113.693276:0:14833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136113.693312:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf97518 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630405 expref: 8 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.693338:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba069d75300) 00010000:00010000:1.0:1789136113.693350:0:14833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136113.693382:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.693399:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.693410:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789136113.693979:0:14833:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f8b0161 reply state 00000000e1234861 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136113.693991:0:14833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789136113.694008:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1789136113.694131:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+9:14677:x1876044696116352:12345-192.168.204.41@tcp:36:lfs.0 Request processed in 969us (4537us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789136113.694140:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 24 00000100:00100000:3.0:1789136113.699081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00010000:00010000:2.0:1789136113.699901:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699916:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699925:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699932:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136113.699938:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699947:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699967:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba069d75d00) 00010000:00010000:2.0:1789136113.699970:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789136113.699976:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.699983:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf9752d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136113.700055:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696116608 00000100:00100000:2.0:1789136113.700068:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696116608 00000100:00100000:2.0:1789136113.700125:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:2.0:1789136113.700136:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+8:14677:x1876044696116608:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:2.0:1789136113.700496:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+9:14677:x1876044696116608:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 360us (1432us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789136113.700542:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789136113.703631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.704030:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696116864 00000100:00100000:1.0:1789136113.704044:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696116864 00000100:00100000:1.0:1789136113.704118:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:1.0:1789136113.704130:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+9:14677:x1876044696116864:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789136113.704159:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.704184:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630413 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704315:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704332:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704346:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704362:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704369:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.704376:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.704564:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789136113.705202:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705212:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705218:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705225:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.705229:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705414:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705431:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.705434:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.705440:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705447:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf9753b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705464:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705470:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705477:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705482:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136113.705485:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705491:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705499:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba069d75600) 00010000:00010000:1.0:1789136113.705502:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136113.705505:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705521:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf97542 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705585:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97534 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630413 expref: 11 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705597:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.705599:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136113.705603:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf97534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630413 expref: 11 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.705613:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7600, rc 0) 00000100:00100000:1.0:1789136113.706068:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+10:14677:x1876044696116864:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1937us (2450us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789136113.706078:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 25 00000100:00100000:2.0:1789136113.713105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136113.713186:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696116992 00000100:00100000:0.0:1789136113.713202:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696116992 00000100:00100000:0.0:1789136113.713276:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:0.0:1789136113.713287:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+10:14677:x1876044696116992:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:0.0:1789136113.713315:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136113.713338:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf97550 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63041a expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713433:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713448:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713492:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136113.713563:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789136113.713567:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789136113.713592:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713620:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140400/0x38eb79866bf97550 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 12 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713643:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136113.713652:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:0.0:1789136113.713655:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136113.713671:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049141600, rc 0) 00000100:00100000:0.0:1789136113.713770:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+11:14677:x1876044696116992:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 484us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136113.713778:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 26 00000100:00100000:2.0:1789136113.726463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.726579:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696117120 00000100:00100000:1.0:1789136113.726594:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696117120 00000100:00100000:1.0:1789136113.726672:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789136113.726697:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+11:14677:x1876044696117120:12345-192.168.204.41@tcp:37:lfs.0 00000100:00100000:0.0:1789136113.738386:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+11:14677:x1876044696117120:12345-192.168.204.41@tcp:37:lfs.0 Request processed in 11691us (11925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136113.738485:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:3.0:1789136113.744542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136113.744676:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696117376 00000100:00100000:2.0:1789136113.744690:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696117376 00000100:00100000:2.0:1789136113.744973:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:2.0:1789136113.744986:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0604f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+11:14677:x1876044696117376:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:2.0:1789136113.745544:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0604f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:23916e5f-ff83-468e-b110-c2c4ea0abd4d+12:14677:x1876044696117376:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 559us (1030us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789136113.745554:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:2.0:1789136113.818404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136113.818540:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696117504 00000100:00100000:3.0:1789136113.818553:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696117504 00000100:00100000:3.0:1789136113.818630:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:3.0:1789136113.818840:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+10:14683:x1876044696117504:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:3.0:1789136113.818868:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136113.819161:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9755e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630421 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819327:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819347:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819361:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819379:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819411:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819419:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819581:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf97573 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819591:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf97573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819599:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf97573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136113.819776:0:15820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789136113.819782:0:15820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789136113.819846:0:15820:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf97573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819862:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819869:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819876:0:15820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819894:0:15820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789136113.819899:0:15820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819915:0:15820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819932:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:3.0:1789136113.819936:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136113.819942:0:15820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819949:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf97565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819966:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819971:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819977:0:15820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819982:0:15820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789136113.819985:0:15820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819991:0:15820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.819997:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ba05c659900) 00010000:00010000:3.0:1789136113.820000:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136113.820002:0:15820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.820018:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9756c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.820060:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf9755e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630421 expref: 12 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.820074:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5e00/0x38eb79866bf97573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630421 expref: 11 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.820081:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:3.0:1789136113.820083:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789136113.820086:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5e00, rc 0) 00000100:00100000:3.0:1789136113.820335:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+11:14683:x1876044696117504:12345-192.168.204.41@tcp:101:bash.0 Request processed in 1499us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136113.820345:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 27 00000100:00100000:3.0:1789136113.830780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136113.831060:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696117760 00000100:00100000:2.0:1789136113.831073:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696117760 00000100:00100000:2.0:1789136113.831148:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 28 00000100:00100000:2.0:1789136113.831160:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c2452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+11:14683:x1876044696117760:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789136113.831186:0:14834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136113.831214:0:14834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9757a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630428 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.831389:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.831407:0:14834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.831418:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.831479:0:14834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.831495:0:14834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 11 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136113.831511:0:14834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14834:1876044723372672:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789136113.831643:0:14834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136113.838209:0:14834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14834:1876044723372672:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789136113.840228:0:14834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136113.844388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136113.847037:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696117888 00000100:00100000:2.0:1789136113.847060:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696117888 00010000:00010000:2.0:1789136113.847144:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 12 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136113.847204:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:2.0:1789136113.847216:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+12:2363:x1876044696117888:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136113.847245:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136113.847254:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 12 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847269:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 12 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847299:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141600/0x38eb79866bf97557 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63041a expref: 12 pid: 14835 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847324:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:2.0:1789136113.847347:0:14818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847359:0:14818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847368:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.847410:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136113.847494:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+11:2363:x1876044696117888:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 280us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136113.847503:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00010000:00010000:3.0:1789136113.848348:0:14834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.848360:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.853154:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.853490:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.853508:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.854366:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.854378:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.854388:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136113.854399:0:14834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789136113.858374:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858402:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858411:0:14834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858417:0:14834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936e00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:3.0:1789136113.858422:0:14834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858430:0:14834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858472:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:3.0:1789136113.858475:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136113.858480:0:14834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858486:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf97581 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136113.858506:0:14834:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000eb926873 reply state 000000000c532389 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136113.858513:0:14834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789136113.858573:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf9757a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 14 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858588:0:14834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 13 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136113.858595:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:3.0:1789136113.858597:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789136113.858599:0:14834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5400, rc 0) 00000100:00100000:3.0:1789136113.858688:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c2452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14683:x1876044696117760:12345-192.168.204.41@tcp:101:bash.0 Request processed in 27530us (27924us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789136113.858713:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 28 00010000:00010000:2.0:1789136113.866589:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866613:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866624:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866631:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136113.866637:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866657:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866680:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ba05c659900) 00010000:00010000:2.0:1789136113.866693:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136113.866758:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.866766:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5200/0x38eb79866bf97588 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136113.869220:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723372800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136113.869340:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136113.869506:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723372800 00000100:00100000:2.0:1789136113.869517:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723372800 00000100:00100000:2.0:1789136113.869597:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136113.869609:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c245680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723372800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136113.869671:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789136113.869776:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c245680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723372800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136113.869785:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136113.869841:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723372800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136113.875562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136113.876391:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696118016 00000100:00100000:3.0:1789136113.876406:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696118016 00000100:00100000:2.0:1789136113.876619:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:2.0:1789136113.876636:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+13:14683:x1876044696118016:12345-192.168.204.41@tcp:101:bash.0 00010000:00010000:2.0:1789136113.876677:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136113.876773:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9759d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63042f expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.876987:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877005:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877022:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136113.877082:0:15820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789136113.877088:0:15820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789136113.877115:0:15820:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877141:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877171:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9759d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 15 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877197:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 14 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136113.877206:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:2.0:1789136113.877209:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136113.877214:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937400, rc 0) 00000100:00100000:2.0:1789136113.877316:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c398f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14683:x1876044696118016:12345-192.168.204.41@tcp:101:bash.0 Request processed in 685us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136113.877325:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:0.0:1789136113.886557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136113.886858:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696118272 00000100:00100000:2.0:1789136113.886882:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696118272 00000100:00100000:2.0:1789136113.886953:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:2.0:1789136113.886968:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14683:x1876044696118272:12345-192.168.204.41@tcp:35:bash.0 00000100:00100000:2.0:1789136113.887497:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:14683:x1876044696118272:12345-192.168.204.41@tcp:35:bash.0 Request processed in 530us (955us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789136113.887506:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:0.0:1789136113.990319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136113.990502:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696118528 00000100:00100000:1.0:1789136113.990517:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696118528 00000100:00100000:1.0:1789136113.990612:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:1.0:1789136113.990624:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:14693:x1876044696118528:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789136113.990667:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136113.990762:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf975ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630436 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136113.991115:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789136113.991415:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf975ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630436 expref: 17 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.991432:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ba069d75100) 00010000:00010000:1.0:1789136113.991436:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136113.991442:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf975ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630436 expref: 17 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136113.991460:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a7600, rc 0) 00000100:00100000:1.0:1789136113.991552:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+16:14693:x1876044696118528:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 930us (1250us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789136113.991561:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:3.0:1789136113.997261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136113.998260:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696118784 00000100:00100000:0.0:1789136113.998275:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696118784 00000100:00100000:0.0:1789136113.998394:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:0.0:1789136113.998406:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+16:14693:x1876044696118784:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:0.0:1789136114.000426:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c246d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+17:14693:x1876044696118784:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 2006us (3166us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789136114.000442:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:0.0:1789136114.112012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.112136:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696119040 00000100:00100000:1.0:1789136114.112149:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696119040 00000100:00100000:1.0:1789136114.112225:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 31 00000100:00100000:1.0:1789136114.112436:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+17:14696:x1876044696119040:12345-192.168.204.41@tcp:101:lfs.0 00010000:00010000:1.0:1789136114.112466:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.112497:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf975b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63043d expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.112655:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf975c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.112672:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf975c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.112923:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf975c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136114.112942:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136114.113334:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7600/0x38eb79866bf975b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63043d expref: 20 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.113362:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf975c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63043d expref: 19 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.113372:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136114.113375:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789136114.113380:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6a00, rc 0) 00000100:00100000:1.0:1789136114.113539:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14696:x1876044696119040:12345-192.168.204.41@tcp:101:lfs.0 Request processed in 1304us (1542us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789136114.113548:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 31 00000100:00100000:1.0:1789136114.125105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.125191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00010000:00010000:2.0:1789136114.125329:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136114.125448:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696119168 00000100:00100000:0.0:1789136114.125463:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696119168 00000100:00100000:0.0:1789136114.125559:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:0.0:1789136114.125571:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14696:x1876044696119168:12345-192.168.204.41@tcp:54:lfs.0 00010000:00010000:0.0:1789136114.125680:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.125947:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.125964:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.125999:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126007:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126014:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126020:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049140200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:0.0:1789136114.126024:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126048:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126064:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:0.0:1789136114.126067:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136114.126074:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.126081:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140200/0x38eb79866bf975ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136114.126192:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0497a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14696:x1876044696119168:12345-192.168.204.41@tcp:54:lfs.0 Request processed in 623us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.126202:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 32 00000100:00100000:3.0:1789136114.127779:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696119296 00000100:00100000:3.0:1789136114.127795:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696119296 00000100:00100000:3.0:1789136114.127886:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:3.0:1789136114.127898:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:2366:x1876044696119296:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136114.127913:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136114.127945:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf975c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63043d expref: 19 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.127965:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:3.0:1789136114.127971:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136114.128035:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:2366:x1876044696119296:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 140us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136114.128043:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789136114.130790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.130993:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696119552 00000100:00100000:2.0:1789136114.131005:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696119552 00000100:00100000:2.0:1789136114.131067:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789136114.131077:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:14696:x1876044696119552:12345-192.168.204.41@tcp:35:lfs.0 00000100:00100000:2.0:1789136114.131419:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14696:x1876044696119552:12345-192.168.204.41@tcp:35:lfs.0 Request processed in 343us (646us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789136114.131428:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:0.0:1789136114.529938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.530280:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696119808 00000100:00100000:2.0:1789136114.530291:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696119808 00000100:00100000:2.0:1789136114.530420:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:2.0:1789136114.530431:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14727:x1876044696119808:12345-192.168.204.41@tcp:101:cat.0 00010000:00010000:2.0:1789136114.530458:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136114.530479:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf975d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630444 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.530590:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf975dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.530604:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf975dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.530615:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf975dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136114.531015:0:15820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136114.531206:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf975d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630444 expref: 22 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.531246:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf975dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630444 expref: 21 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.531255:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:2.0:1789136114.531258:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136114.531262:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072936e00, rc 0) 00000100:00100000:2.0:1789136114.531349:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14727:x1876044696119808:12345-192.168.204.41@tcp:101:cat.0 Request processed in 920us (1424us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789136114.531358:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 33 00000100:00100000:3.0:1789136114.535280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.535326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.536231:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120064 00000100:00100000:2.0:1789136114.536242:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120064 00000100:00100000:2.0:1789136114.536309:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:2.0:1789136114.536319:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14727:x1876044696120064:12345-192.168.204.41@tcp:35:cat.0 00000100:00100000:0.0:1789136114.537752:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120192 00000100:00100000:0.0:1789136114.537765:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120192 00000100:00100000:0.0:1789136114.537823:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:0.0:1789136114.537833:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:2365:x1876044696120192:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136114.537847:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136114.537885:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936e00/0x38eb79866bf975dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630444 expref: 23 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.537908:0:14820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:0.0:1789136114.537914:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136114.537977:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+22:2365:x1876044696120192:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 146us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.538003:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:2.0:1789136114.539426:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14727:x1876044696120064:12345-192.168.204.41@tcp:35:cat.0 Request processed in 3102us (4148us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789136114.539437:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 8 00000100:00100000:3.0:1789136114.616356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.617173:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120448 00000100:00100000:0.0:1789136114.617190:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120448 00000100:00100000:0.0:1789136114.617288:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:0.0:1789136114.617299:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14733:x1876044696120448:12345-192.168.204.41@tcp:101:dd.0 00010000:00010000:0.0:1789136114.617328:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136114.617349:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141800/0x38eb79866bf975ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63044b expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617453:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617469:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617478:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 22 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617487:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617537:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 22 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617551:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 22 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136114.617567:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14835:1876044723372928:192.168.204.41@tcp:104: 00010000:00010000:0.0:1789136114.617743:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.617753:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136114.617762:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14835:1876044723373056:192.168.204.41@tcp:104: 00000100:00100000:0.0:1789136114.617793:0:14835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0504f3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136114.623174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.623753:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120576 00000100:00100000:2.0:1789136114.623764:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120576 00010000:00010000:2.0:1789136114.623806:0:14818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 23 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136114.623855:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:2.0:1789136114.623864:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0739a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:2363:x1876044696120576:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136114.623907:0:14818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136114.623919:0:14818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 23 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.623933:0:14818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 23 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.623957:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:2.0:1789136114.623962:0:14818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.623970:0:14818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.623976:0:14818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136114.624036:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0739a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:2363:x1876044696120576:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 173us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.624045:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:3.0:1789136114.624563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.624667:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120704 00000100:00100000:3.0:1789136114.624671:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120704 00010000:00010000:3.0:1789136114.624690:0:14819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 23 pid: 14834 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.624724:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937400/0x38eb79866bf975a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63042f expref: 23 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.624728:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789136114.624736:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+22:2365:x1876044696120704:12345-192.168.204.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789136114.624743:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14835:1876044723372928:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789136114.624744:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136114.624748:0:14819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136114.624755:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14835:1876044723373056:192.168.204.41@tcp:104: 00010000:00010000:3.0:1789136114.624766:0:14819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.624779:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf9758f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630428 expref: 22 pid: 14834 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.624783:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.624790:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:3.0:1789136114.624794:0:14819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.624801:0:14819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.625372:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.625436:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136114.625528:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:2365:x1876044696120704:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 791us (964us total) trans 0 rc 0/0 00010000:00010000:1.0:1789136114.625535:0:14835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.625537:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00010000:00010000:1.0:1789136114.625542:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136114.625561:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136114.625777:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141800/0x38eb79866bf975ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63044b expref: 22 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.625794:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140e00/0x38eb79866bf975f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63044b expref: 21 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.625801:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136114.625804:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789136114.625807:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140e00, rc 0) 00000100:00100000:1.0:1789136114.625834:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14733:x1876044696120448:12345-192.168.204.41@tcp:101:dd.0 Request processed in 8538us (9495us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789136114.625841:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 34 00000100:00100000:3.0:1789136114.628407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.628556:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696120960 00000100:00100000:1.0:1789136114.628565:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696120960 00000100:00100000:1.0:1789136114.628669:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 35 00000100:00100000:1.0:1789136114.628680:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+21:14733:x1876044696120960:12345-192.168.204.41@tcp:36:dd.0 00010000:00010000:1.0:1789136114.628977:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.628992:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.629015:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136114.629065:0:14833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789136114.629101:0:14833:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000de177404 reply state 000000009f02c64c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136114.629111:0:14833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789136114.629194:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14733:x1876044696120960:12345-192.168.204.41@tcp:36:dd.0 Request processed in 516us (995us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789136114.629201:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 35 00000020:00080000:1.0:1789136114.629206:0:14833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789136114.632591:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632608:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632616:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632622:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136114.632628:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632636:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632667:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:2.0:1789136114.632670:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136114.632676:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.632682:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6400/0x38eb79866bf975ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.633015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.633089:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121088 00000100:00100000:0.0:1789136114.633099:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121088 00000100:00100000:0.0:1789136114.633159:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:0.0:1789136114.633169:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14733:x1876044696121088:12345-192.168.204.41@tcp:101:dd.0 00010000:00010000:0.0:1789136114.633197:0:14834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136114.633225:0:14834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf97606 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630452 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.633281:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf97606 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630452 expref: 25 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.633295:0:14834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf97606 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630452 expref: 25 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.633319:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:0.0:1789136114.633322:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136114.633324:0:14834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140000, rc 0) 00000100:00100000:0.0:1789136114.633383:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+25:14733:x1876044696121088:12345-192.168.204.41@tcp:101:dd.0 Request processed in 215us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.633398:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 36 00000100:00100000:0.0:1789136114.650315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.650434:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121344 00000100:00100000:1.0:1789136114.650442:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121344 00000100:00100000:1.0:1789136114.650574:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:1.0:1789136114.650586:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14733:x1876044696121344:12345-192.168.204.41@tcp:103:dd.0 00010000:00010000:1.0:1789136114.650602:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136114.650627:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140000/0x38eb79866bf97606 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630452 expref: 24 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.650647:0:14820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136114.650653:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136114.650853:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:14733:x1876044696121344:12345-192.168.204.41@tcp:103:dd.0 Request processed in 262us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.650860:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789136114.652941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.653033:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121472 00000100:00100000:2.0:1789136114.653041:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121472 00000100:00100000:2.0:1789136114.653099:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:2.0:1789136114.653109:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:14733:x1876044696121472:12345-192.168.204.41@tcp:58:dd.0 00010000:00010000:2.0:1789136114.653230:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.653247:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.653260:0:15820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136114.654482:0:15820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136114.654730:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789136114.654805:0:15820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789136114.654964:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:14733:x1876044696121472:12345-192.168.204.41@tcp:58:dd.0 Request processed in 1853us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.654974:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 37 00000100:00100000:3.0:1789136114.657075:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.657171:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121600 00000100:00100000:0.0:1789136114.657180:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121600 00000100:00100000:0.0:1789136114.657292:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 38 00000100:00100000:0.0:1789136114.657303:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+23:14733:x1876044696121600:12345-192.168.204.41@tcp:101:dd.0 00010000:00010000:0.0:1789136114.657327:0:14834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136114.657348:0:14834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630459 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657409:0:14834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657420:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 24 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657438:0:14834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657452:0:14834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 24 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657466:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:0.0:1789136114.657469:0:14834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136114.657472:0:14834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 24 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.657479:0:14834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049141000, rc 0) 00000100:00100000:0.0:1789136114.657567:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14733:x1876044696121600:12345-192.168.204.41@tcp:101:dd.0 Request processed in 266us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.657574:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 38 00000040:00080000:0.0:1789136114.700997:0:14868:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136114.701007:0:14868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789136114.701059:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789136114.701066:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789136114.701238:0:14868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14868:1876044723373184:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789136114.701338:0:14868:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0504f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136114.722528:0:14868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14868:1876044723373184:192.168.204.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789136114.728794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.729501:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121728 00000100:00100000:1.0:1789136114.729524:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121728 00000100:00100000:1.0:1789136114.729662:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789136114.729673:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121728:12345-192.168.204.41@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789136114.729808:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121728:12345-192.168.204.41@tcp:900:lhsmtool_posix.0 Request processed in 137us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.729816:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:2.0:1789136114.738458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.740914:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121856 00000100:00100000:3.0:1789136114.740927:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121856 00000100:00100000:3.0:1789136114.740992:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:3.0:1789136114.741026:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121856:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789136114.741063:0:14833:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789136114.741180:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121856:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 157us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136114.741188:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 39 00000100:00100000:2.0:1789136114.756839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.757034:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696121984 00000100:00100000:1.0:1789136114.757044:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696121984 00000100:00100000:1.0:1789136114.757120:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:1.0:1789136114.757131:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121984:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.757209:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757227:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757241:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757302:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757310:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757317:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757342:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757363:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757370:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136114.757416:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789136114.757421:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136114.757433:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757443:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757449:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757456:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757462:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136114.757466:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757475:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757487:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba069d75800) 00010000:00010000:1.0:1789136114.757491:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136114.757496:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757521:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9761b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757534:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757539:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757545:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757550:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136114.757552:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757557:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757565:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ba069d75600) 00010000:00010000:1.0:1789136114.757567:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136114.757569:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757574:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97622 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757585:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757590:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757602:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757606:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6600 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136114.757608:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757614:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757621:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136114.757623:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136114.757626:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.757632:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97629 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136114.757759:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072eed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696121984:12345-192.168.204.41@tcp:34:lhsmtool_posix.0 Request processed in 630us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.757768:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 40 00000100:00100000:3.0:1789136114.766289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.766468:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696122240 00000100:00100000:1.0:1789136114.766478:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696122240 00000100:00100000:1.0:1789136114.766554:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:1.0:1789136114.766565:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+24:14735:x1876044696122240:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.766591:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.766612:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97630 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630460 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766767:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766783:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766795:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136114.766807:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136114.766932:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766940:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766947:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766952:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6000 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136114.766957:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766964:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766975:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136114.766979:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789136114.766983:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.766998:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97637 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.767048:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97630 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630460 expref: 26 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.767060:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ba069d75800) 00010000:00010000:1.0:1789136114.767062:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136114.767066:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97630 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630460 expref: 26 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.767076:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6600, rc 0) 00000100:00100000:1.0:1789136114.767133:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba072f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+25:14735:x1876044696122240:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 570us (856us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789136114.767141:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 41 00000100:00100000:2.0:1789136114.782577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.783254:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696122368 00000100:00100000:1.0:1789136114.783267:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696122368 00000100:00100000:1.0:1789136114.783336:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:1.0:1789136114.783347:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+25:14735:x1876044696122368:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789136114.783387:0:14835:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789136114.783557:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c244f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+25:14735:x1876044696122368:12345-192.168.204.41@tcp:53:lhsmtool_posix.0 Request processed in 211us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.783566:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 42 00000100:00100000:0.0:1789136114.793308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.794255:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696122624 00000100:00100000:1.0:1789136114.794266:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696122624 00000100:00100000:1.0:1789136114.794338:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:1.0:1789136114.794363:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+25:14735:x1876044696122624:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.794386:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.794413:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97645 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630467 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789136114.795532:0:14833:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1789136114.795541:0:14833:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789136114.795598:0:14833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789136114.797152:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9764c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.797172:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9764c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.797186:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9764c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.797270:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6600/0x38eb79866bf97645 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630467 expref: 28 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.797292:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9764c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630467 expref: 27 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.797321:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:0.0:1789136114.797324:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136114.797328:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140c00, rc 0) 00000100:00100000:0.0:1789136114.797419:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+27:14735:x1876044696122624:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 3058us (4122us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789136114.797428:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 43 00000100:00100000:3.0:1789136114.805288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.805450:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696122880 00000100:00100000:1.0:1789136114.805484:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696122880 00000100:00100000:1.0:1789136114.805578:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:1.0:1789136114.805590:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+27:14735:x1876044696122880:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.805659:0:14835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136114.805907:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9764c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630467 expref: 27 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.805933:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52800) 00010000:00010000:1.0:1789136114.805944:0:14835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136114.826260:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826287:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826302:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826323:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826329:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826336:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826420:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826428:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826434:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826440:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136114.826445:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826454:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826499:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ba06ca52e00) 00010000:00010000:2.0:1789136114.826511:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136114.826517:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826524:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936200/0x38eb79866bf9765a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826539:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826545:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826551:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826557:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136114.826559:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826565:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826573:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4b07e902 (ffff8ba0486c1f00) 00010000:00010000:2.0:1789136114.826576:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136114.826579:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.826585:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97661 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4b07e902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136114.826732:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+26:14735:x1876044696122880:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 21138us (21456us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789136114.826742:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 44 00000100:00100000:3.0:1789136114.832175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.832281:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696123008 00000100:00100000:0.0:1789136114.832302:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696123008 00000100:00100000:0.0:1789136114.832387:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789136114.832398:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+26:14735:x1876044696123008:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136114.832423:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136114.832452:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf97668 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63046e expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.832620:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9766f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.832634:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9766f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.832647:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9766f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.833896:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf97668 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63046e expref: 28 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.837265:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049140c00/0x38eb79866bf9766f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63046e expref: 27 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.837296:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:0.0:1789136114.837300:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136114.837304:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba049140c00, rc 0) 00000100:00100000:0.0:1789136114.837399:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+27:14735:x1876044696123008:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 5002us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.837409:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 45 00000100:00100000:0.0:1789136114.848162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.848410:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696123264 00000100:00100000:2.0:1789136114.848432:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696123264 00000100:00100000:2.0:1789136114.848549:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 46 00000100:00100000:2.0:1789136114.848564:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+27:14735:x1876044696123264:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789136114.848675:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.848753:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.848767:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136114.850480:0:14834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789136114.850499:0:14834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 588724797544ns, next at 589724794052ns, rc = 0 00000004:00010000:3.0:1789136114.851075:0:14834:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bcd094ab reply state 0000000078f96262 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.851093:0:14834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136114.851634:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+29:14735:x1876044696123264:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 3066us (3482us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789136114.851648:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 46 00010000:00010000:2.0:1789136114.857147:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857170:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857178:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857185:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937200 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136114.857191:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857225:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857256:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:2.0:1789136114.857260:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789136114.857266:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.857274:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072937200/0x38eb79866bf97676 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136114.859940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.860083:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696123392 00000100:00100000:3.0:1789136114.860098:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696123392 00000100:00100000:3.0:1789136114.860184:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:3.0:1789136114.860196:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+28:14735:x1876044696123392:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136114.860228:0:15820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136114.860260:0:15820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630475 expref: -99 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.860360:0:15820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 29 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.860406:0:15820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 29 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.860430:0:15820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:3.0:1789136114.860435:0:15820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136114.860439:0:15820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba07c1a5600, rc 0) 00000100:00100000:3.0:1789136114.860536:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c247c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+29:14735:x1876044696123392:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 342us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136114.860545:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 47 00000100:00100000:3.0:1789136114.869342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.869631:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696123520 00000100:00100000:1.0:1789136114.869643:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696123520 00000100:00080000:2.0:1789136114.869735:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136114.869821:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:1.0:1789136114.869837:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696123520:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789136114.871242:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2364:x1876044696123520:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 1146us (1651us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789136114.871537:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 12 00000100:00100000:3.0:1789136114.879878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.888395:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696123776 00000100:00100000:2.0:1789136114.888412:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696123776 00000100:00100000:2.0:1789136114.888528:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:2.0:1789136114.888541:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+29:14735:x1876044696123776:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789136114.889564:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+30:14735:x1876044696123776:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 1022us (9694us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789136114.889575:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 9 00000100:00100000:2.0:1789136114.899174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.899513:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124032 00000100:00100000:0.0:1789136114.899523:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124032 00000100:00100000:0.0:1789136114.899584:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:0.0:1789136114.899595:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+30:14735:x1876044696124032:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789136114.899774:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba073c8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+30:14735:x1876044696124032:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 180us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.899781:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 48 00000100:00100000:3.0:1789136114.905660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.906915:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124160 00000100:00100000:1.0:1789136114.906927:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124160 00000100:00100000:1.0:1789136114.906993:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:1.0:1789136114.907003:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+30:14735:x1876044696124160:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.907044:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.907067:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97684 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63047c expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907134:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907149:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907161:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136114.907196:0:14833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789136114.907213:0:14833:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907238:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6000/0x38eb79866bf97684 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63047c expref: 32 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907255:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63047c expref: 31 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.907265:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:1.0:1789136114.907268:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789136114.907272:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6200, rc 0) 00000100:00100000:1.0:1789136114.907337:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+31:14735:x1876044696124160:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 335us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.907345:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 49 00000100:00100000:3.0:1789136114.913199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136114.915020:0:16499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124288 00000100:00100000:1.0:1789136114.915034:0:16499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124288 00000100:00100000:1.0:1789136114.915117:0:16499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:1.0:1789136114.915129:0:16499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+6:2363:x1876044696124288:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136114.915152:0:16499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.915176:0:16499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a630483 expref: -99 pid: 16499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136114.915204:0:16499:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40cf1, blocks: 0x1 00010000:00010000:1.0:1789136114.915225:0:16499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1789136114.915231:0:16499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136114.915242:0:16499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 7 pid: 16499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.915262:0:16499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 7 pid: 16499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.915275:0:16499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba0738a6000, rc 0) 00000100:00100000:1.0:1789136114.915343:0:16499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2363:x1876044696124288:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 216us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.915351:0:16499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:2.0:1789136114.918400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.918519:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124544 00000100:00100000:3.0:1789136114.918531:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124544 00000100:00100000:3.0:1789136114.918589:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789136114.918599:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+31:14735:x1876044696124544:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789136114.918748:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+31:14735:x1876044696124544:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136114.918755:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 50 00000100:00100000:3.0:1789136114.923169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.923618:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124672 00000100:00100000:2.0:1789136114.923638:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124672 00000100:00100000:2.0:1789136114.923907:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:0.0:1789136114.923988:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+31:14735:x1876044696124672:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789136114.970510:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1789136114.970547:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1789136114.970555:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1789136114.970569:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1789136114.970578:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789136114.970859:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723373312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789136114.970949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136114.971240:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14735:x1876044696124672:12345-192.168.204.41@tcp:44:lhsmtool_posix.0 Request processed in 47319us (48079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136114.971251:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 51 00000100:00100000:2.0:1789136114.971381:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723373312 00000100:00100000:2.0:1789136114.971391:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723373312 00000100:00100000:2.0:1789136114.971450:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136114.971465:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723373312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789136114.971630:0:15518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789136114.971634:0:15518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789136114.971637:0:15518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789136114.971639:0:15518:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789136113 -> 1789136113 00002000:00010000:2.0:1789136114.971641:0:15518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789136114.971675:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876044723373312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (726us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789136114.971681:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789136114.971929:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ba05c3e3c00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789136114.971936:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723373312:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789136114.974410:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136114.975894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.976259:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696124800 00000100:00100000:2.0:1789136114.976270:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696124800 00000100:00100000:2.0:1789136114.976325:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:2.0:1789136114.976335:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2363:x1876044696124800:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789136114.976605:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2363:x1876044696124800:12345-192.168.204.41@tcp:16:lhsmtool_posix.0 Request processed in 270us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.976614:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:1.0:1789136114.980543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:3.0:1789136114.980616:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125056 00000100:00100000:3.0:1789136114.980632:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125056 00000100:00100000:3.0:1789136114.980679:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 52 00000100:00100000:3.0:1789136114.980687:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14735:x1876044696125056:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789136114.980787:0:14834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136114.980817:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6200/0x38eb79866bf9768b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63047c expref: 14 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.980835:0:14834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:3.0:1789136114.980840:0:14834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136114.980871:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.980884:0:14834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.980893:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136114.981084:0:14834:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f9877f06 reply state 00000000c874a268 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.981093:0:14834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136114.981185:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:14735:x1876044696125056:12345-192.168.204.41@tcp:36:lhsmtool_posix.0 Request processed in 499us (651us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789136114.981192:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 52 00010000:00010000:2.0:1789136114.984793:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984816:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984826:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984833:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a5400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:2.0:1789136114.984838:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984869:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984890:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:2.0:1789136114.984893:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136114.984898:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.984905:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5400/0x38eb79866bf97699 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136114.985585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136114.985667:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125184 00000100:00100000:2.0:1789136114.985676:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125184 00000100:00100000:2.0:1789136114.985771:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:2.0:1789136114.985783:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:14735:x1876044696125184:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789136114.985807:0:15518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136114.985825:0:15518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcff3c21b8a63048a expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.985860:0:15518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.985872:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136114.985876:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136114.985881:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.985932:0:15518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.985945:0:15518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136114.985960:0:15518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba05c3e2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15518:1876044723373440:192.168.204.41@tcp:104: 00000100:00100000:2.0:1789136114.986041:0:15518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba07c117e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136114.989800:0:15518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba05c3e2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15518:1876044723373440:192.168.204.41@tcp:104: 00010000:00010000:2.0:1789136114.989839:0:15518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.989860:0:15518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ba072937c00, rc 0) 00000100:00100000:2.0:1789136114.989919:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:14735:x1876044696125184:12345-192.168.204.41@tcp:101:lhsmtool_posix.0 Request processed in 4139us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.989929:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 16 00000100:00100000:3.0:1789136114.993357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136114.993479:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125312 00000100:00100000:0.0:1789136114.993487:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125312 00010000:00010000:0.0:1789136114.993535:0:14819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136114.993641:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:0.0:1789136114.993650:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:2364:x1876044696125312:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136114.993678:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136114.993739:0:14819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.993753:0:14819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.993777:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b50953/0x38eb79866bf97692 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630483 expref: 8 pid: 16499 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.993793:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136114.993797:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136114.993803:0:14819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.993813:0:14819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136114.993849:0:14819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136114.993885:0:14819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14819:1876044723373568:192.168.204.41@tcp:105: 00000100:00100000:0.0:1789136114.993964:0:14819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba0580f16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136115.001111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136115.001200:0:16499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125440 00000100:00100000:2.0:1789136115.001211:0:16499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125440 00000100:00100000:2.0:1789136115.001274:0:16499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:2.0:1789136115.001283:0:16499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:2363:x1876044696125440:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789136115.001489:0:16499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789136115.001493:0:16499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789136113 00002000:00010000:2.0:1789136115.001495:0:16499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789136112 00002000:00010000:2.0:1789136115.001521:0:16499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789136113 -> 1789136113 00002000:00010000:2.0:1789136115.001523:0:16499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789136115.001585:0:16499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:2363:x1876044696125440:12345-192.168.204.41@tcp:2:lhsmtool_posix.0 Request processed in 303us (486us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789136115.001594:0:16499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 17 00000100:00100000:0.0:1789136115.001881:0:14819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c2d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14819:1876044723373568:192.168.204.41@tcp:105: 00010000:00010000:0.0:1789136115.001902:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136115.001924:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:2364:x1876044696125312:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 8275us (8578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136115.001932:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 13 00000100:00100000:3.0:1789136115.006416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136115.007013:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125568 00000100:00100000:1.0:1789136115.007022:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125568 00000100:00100000:1.0:1789136115.007131:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:1.0:1789136115.007141:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:2365:x1876044696125568:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789136115.007188:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.007210:0:15521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.007230:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.007234:0:15521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789136115.007240:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.007274:0:15521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.007289:0:15521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 8 pid: 15518 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.007319:0:15521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15521:1876044723373696:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789136115.007412:0:15521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136115.010450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136115.010574:0:15521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15521:1876044723373696:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789136115.010605:0:15521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.011171:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125696 00000100:00100000:0.0:1789136115.011180:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125696 00010000:00010000:0.0:1789136115.011234:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 9 pid: 15518 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.011274:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 14 00000100:00100000:0.0:1789136115.011283:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:2364:x1876044696125696:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136115.011298:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136115.011322:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 9 pid: 15518 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.011335:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 9 pid: 15518 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.011359:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bf7066/0x38eb79866bf976a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a63048a expref: 9 pid: 15518 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.011400:0:14820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789136115.011405:0:14820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789136115.011411:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.011421:0:14820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.011452:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136115.011516:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+8:2364:x1876044696125696:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 233us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136115.011524:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 14 00010000:00010000:1.0:1789136115.011745:0:15521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011756:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011778:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011787:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011796:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011803:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136115.011807:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011822:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011835:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.011844:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.011887:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2365:x1876044696125568:12345-192.168.204.41@tcp:1:lhsmtool_posix.0 Request processed in 4749us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136115.011895:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:3.0:1789136115.016177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136115.016293:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696125952 00000100:00100000:1.0:1789136115.016302:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696125952 00000100:00100000:1.0:1789136115.016381:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 53 00000100:00100000:1.0:1789136115.016392:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+14:14735:x1876044696125952:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 00000100:00080000:0.0:1789136115.016396:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789136115.016476:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.016495:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.016520:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.017079:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.017099:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 15 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.017109:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.017144:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 15 pid: 15820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.017159:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 15 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.017173:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14833:1876044723373824:192.168.204.41@tcp:104: 00000100:00100000:1.0:1789136115.018397:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136115.022260:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14833:1876044723373824:192.168.204.41@tcp:104: 00010000:00010000:1.0:1789136115.022292:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136115.022826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.023250:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126080 00000100:00100000:0.0:1789136115.023258:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126080 00010000:00010000:0.0:1789136115.023300:0:14819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 16 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.023397:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 15 00000100:00100000:0.0:1789136115.023406:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+16:2364:x1876044696126080:12345-192.168.204.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136115.023422:0:14819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136115.023429:0:14819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 16 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023442:0:14819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 16 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023483:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba07c1a5600/0x38eb79866bf9767d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630475 expref: 16 pid: 15820 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023511:0:14819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:0.0:1789136115.023518:0:14819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023530:0:14819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023539:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.023573:0:14819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136115.023637:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:2364:x1876044696126080:12345-192.168.204.41@tcp:103:ldlm_bl.0 Request processed in 229us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136115.023645:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 15 00010000:00010000:1.0:1789136115.024143:0:14833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.024157:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136115.024353:0:14833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789136115.024516:0:14833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789136115.024558:0:14833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789136115.024633:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14833:1876044723373952:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789136115.024774:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136115.024799:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65480 going to sleep for 11 seconds 00000100:00100000:3.0:1789136115.024881:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723373952 00000100:00100000:3.0:1789136115.024887:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723373952 00000100:00100000:3.0:1789136115.024928:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136115.024935:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14833:x1876044723373952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789136115.025006:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14833:x1876044723373952:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136115.025014:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136115.025455:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14833:1876044723373952:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789136115.026080:0:14833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789136115.026233:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14833:1876044723374080:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789136115.026275:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136115.026306:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136115.026454:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374080 00000100:00100000:0.0:1789136115.026460:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374080 00000100:00100000:0.0:1789136115.026491:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136115.026511:0:14838:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789136115.026513:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14833:x1876044723374080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789136115.026522:0:14838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789136115.026723:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14833:x1876044723374080:12345-0@lo:1000:mdt00_000.0 Request processed in 223us (446us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789136115.026731:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136115.026802:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f11680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14833:1876044723374080:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789136115.026832:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026840:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026848:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026854:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136115.026859:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026866:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026883:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:1.0:1789136115.026886:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789136115.026891:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026898:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7a00/0x38eb79866bf976b5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026930:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026936:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026942:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026948:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136115.026950:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026956:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026963:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136115.026966:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789136115.026972:0:14833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 18 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026983:0:14833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 18 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.026992:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 18 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.027037:0:14833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141000/0x38eb79866bf97614 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.41@tcp remote: 0xcff3c21b8a630459 expref: 18 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.027060:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f12580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14833:1876044723374208:192.168.204.41@tcp:105: 00000100:00100000:1.0:1789136115.028312:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ba06ca65600 going to sleep for 11 seconds 00000100:00100000:3.0:1789136115.031380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.031495:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126208 00000100:00100000:0.0:1789136115.031517:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126208 00000100:00100000:0.0:1789136115.031576:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:0.0:1789136115.031585:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0604f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14733:x1876044696126208:12345-192.168.204.41@tcp:49:dd.0 00000100:00100000:0.0:1789136115.031906:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0604f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:14733:x1876044696126208:12345-192.168.204.41@tcp:49:dd.0 Request processed in 321us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136115.031914:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 10 00000100:00100000:1.0:1789136115.032580:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f12580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14833:1876044723374208:192.168.204.41@tcp:105: 00010000:00010000:1.0:1789136115.032611:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032673:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba072936a00/0x38eb79866bf9760d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032880:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032897:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032910:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032919:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032926:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032933:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032938:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136115.032942:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032961:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032974:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136115.032977:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136115.032981:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032987:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a6a00/0x38eb79866bf976bc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.032997:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033003:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033009:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033014:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc1f024f0) 00010000:00010000:1.0:1789136115.033017:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033023:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033030:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ba05c659b00) 00010000:00010000:1.0:1789136115.033032:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136115.033035:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.033050:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba0738a7400/0x38eb79866bf976ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.033423:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:14735:x1876044696125952:12345-192.168.204.41@tcp:57:lhsmtool_posix.0 Request processed in 17031us (17251us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789136115.033433:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 53 00000020:00080000:1.0:1789136115.033439:0:14833:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789136115.034602:0:14868:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136115.034611:0:14868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789136115.034912:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789136115.034919:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789136115.035308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.035411:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126464 00000100:00100000:0.0:1789136115.035418:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126464 00000100:00100000:0.0:1789136115.035466:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 11 00000100:00100000:0.0:1789136115.035959:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:14735:x1876044696126464:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789136115.037991:0:14836:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789136115.038118:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789136115.038176:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038193:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038207:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038283:0:14836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038291:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038297:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.038384:0:14836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789136115.038489:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+20:14735:x1876044696126464:12345-192.168.204.41@tcp:35:lhsmtool_posix.0 Request processed in 2533us (3183us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789136115.038513:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 11 00000020:00080000:0.0:1789136115.038520:0:14836:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789136115.044493:0:16066:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136115.044521:0:16066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.044532:0:16066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136115.044537:0:16066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.044546:0:16066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.044567:0:16066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ba06ca52200) 00010000:00010000:3.0:1789136115.044570:0:16066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789136115.044574:0:16066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.044582:0:16066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ba049141400/0x38eb79866bf976c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.044602:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136115.044604:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136115.044606:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136115.149083:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136115.243030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136115.243062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136115.243093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:1.0:1789136115.243191:0:15526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126592 00000100:00100000:1.0:1789136115.243200:0:15526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126592 00000100:00100000:1.0:1789136115.243256:0:15526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126720 00000100:00100000:1.0:1789136115.243258:0:15526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126720 00000100:00100000:1.0:1789136115.243270:0:15526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126848 00000100:00100000:1.0:1789136115.243272:0:15526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126848 00000100:00100000:1.0:1789136115.243287:0:15526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:1.0:1789136115.243295:0:15526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+9:2364:x1876044696126592:12345-192.168.204.41@tcp:4:dd.0 00002000:00010000:1.0:1789136115.243347:0:15526:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa40cf1, atime: 0x6aa40cf0, ctime: 0x6aa40cf1, blocks: 0x1 00010000:00010000:1.0:1789136115.243357:0:15526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.243375:0:15526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:1.0:1789136115.243380:0:15526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.243387:0:15526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.243424:0:15526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136115.253485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.255376:0:15525:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136115.255399:0:15525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789136115.257563:0:15525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696126976 00000100:00100000:0.0:1789136115.257576:0:15525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696126976 00000100:00100000:1.0:1789136115.258781:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:1.0:1789136115.258795:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+11:2364:x1876044696126720:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:1.0:1789136115.258834:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.258852:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.258857:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.258863:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.258877:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136115.264685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136115.270530:0:15524:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789136115.273742:0:15525:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789136115.288762:0:15524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789136115.289045:0:15524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127104 00000100:00100000:2.0:1789136115.289057:0:15524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127104 00000100:00100000:2.0:1789136115.291552:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:2.0:1789136115.291576:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+13:2363:x1876044696126848:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:2.0:1789136115.291624:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.291644:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136115.291648:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136115.291655:0:17068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.291669:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.291857:0:15525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1789136115.293254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.293294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.293332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:0.0:1789136115.293372:0:15525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127232 00000100:00100000:0.0:1789136115.293381:0:15525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127232 00000100:00100000:0.0:1789136115.293434:0:15525:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1789136115.293442:0:15525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127488 00000100:00100000:0.0:1789136115.293445:0:15525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127488 00000100:00100000:0.0:1789136115.293454:0:15525:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1789136115.293459:0:15525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127360 00000100:00100000:0.0:1789136115.293461:0:15525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127360 00000100:00100000:0.0:1789136115.294547:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:0.0:1789136115.294559:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+17:2363:x1876044696126976:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:0.0:1789136115.294598:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.294618:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136115.294622:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136115.294635:0:17069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.294649:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789136115.376505:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1789136115.376524:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1789136115.376954:0:15526:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789136115.376970:0:15526:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789136113 -> 1789136114 00002000:00010000:2.0:1789136115.376974:0:15526:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789136113 -> 1789136114 00002000:00010000:2.0:1789136115.376977:0:15526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1789136115.376994:0:15526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377007:0:15526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377017:0:15526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377024:0:15526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a7400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136115.377030:0:15526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377040:0:15526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377065:0:15526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377074:0:15526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f182920e/0x38eb79866bf976ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136115.377184:0:15526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+19:2364:x1876044696126592:12345-192.168.204.41@tcp:4:dd.0 Request processed in 133883us (134157us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789136115.377195:0:15526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 0 00000100:00100000:2.0:1789136115.377310:0:15526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 4 00000100:00100000:2.0:1789136115.377326:0:15526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:2363:x1876044696127104:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:2.0:1789136115.377372:0:15526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377385:0:15526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136115.377391:0:15526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136115.377398:0:15526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.377412:0:15526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136115.378168:0:17067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1789136115.378185:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378201:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378213:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378220:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136115.378224:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378232:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378248:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.378257:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136115.379669:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+18:2364:x1876044696126720:12345-192.168.204.41@tcp:4:dd.0 Request processed in 120864us (136592us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789136115.379687:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 1 00000100:00100000:3.0:1789136115.379759:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 5 00000100:00100000:3.0:1789136115.379786:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+17:2363:x1876044696127232:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:3.0:1789136115.379829:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.379848:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136115.379853:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136115.379860:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.379876:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789136115.418742:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789136115.419225:0:17069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1789136115.419230:0:17069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789136115.419248:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419265:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419276:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419285:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba049141c00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:1.0:1789136115.419300:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419311:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419342:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419350:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c60dd9/0x38eb79866bf976df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136115.419474:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+17:2363:x1876044696126976:12345-192.168.204.41@tcp:4:dd.0 Request processed in 124910us (165992us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789136115.419484:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 3 00000100:00100000:1.0:1789136115.419556:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 6 00000100:00100000:1.0:1789136115.419573:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+16:2364:x1876044696127488:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:1.0:1789136115.419865:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.419998:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.420004:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136115.420011:0:17069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136115.420026:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136115.420671:0:17068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789136115.420685:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420694:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420730:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420736:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072937400 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:3.0:1789136115.420740:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420748:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420775:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420783:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd754ed4/0x38eb79866bf976d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136115.420833:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+16:2363:x1876044696126848:12345-192.168.204.41@tcp:4:dd.0 Request processed in 129263us (177735us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789136115.420842:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 2 00000100:00100000:3.0:1789136115.420887:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:3.0:1789136115.420899:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:2364:x1876044696127360:12345-192.168.204.41@tcp:4:dd.0 00010000:00010000:3.0:1789136115.420923:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420934:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136115.420937:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136115.420942:0:17068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136115.420952:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789136115.469272:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:2.0:1789136115.469303:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1789136115.469851:0:17067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:0.0:1789136115.469872:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469888:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469898:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469907:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4000 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136115.469912:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469925:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469951:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.469978:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000347279a3/0x38eb79866bf976ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.470102:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+15:2363:x1876044696127232:12345-192.168.204.41@tcp:4:dd.0 Request processed in 90317us (176848us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789136115.470115:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 5 00002000:00010000:2.0:1789136115.476940:0:15526:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1789136115.476970:0:15526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.476985:0:15526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.476995:0:15526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.477003:0:15526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba072936800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136115.477009:0:15526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.477046:0:15526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.477073:0:15526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.477082:0:15526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c38f4bd7/0x38eb79866bf976e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136115.477218:0:15526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f462570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+13:2363:x1876044696127104:12345-192.168.204.41@tcp:4:dd.0 Request processed in 99891us (212534us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789136115.477230:0:15526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 4 00000001:00080000:1.0:1789136115.519690:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1789136115.520083:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.520103:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.520114:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.520121:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba0738a6a00 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:2.0:1789136115.520127:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.522966:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.523001:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136115.523011:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021578d5/0x38eb79866bf976f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136115.523498:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+7:2364:x1876044696127488:12345-192.168.204.41@tcp:4:dd.0 Request processed in 103916us (230186us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789136115.523512:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 6 00010000:00010000:0.0:1789136115.523661:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523673:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523683:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523691:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ba07c1a4800 already unused, calling callback (ffffffffc14ad540) 00010000:00010000:0.0:1789136115.523695:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523734:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523748:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136115.523782:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079b27ef6/0x38eb79866bf976fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136115.523830:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2364:x1876044696127360:12345-192.168.204.41@tcp:4:dd.0 Request processed in 102935us (230496us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789136115.523838:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 7 00000100:00100000:2.0:1789136116.088838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.088885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.088927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.088972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.089004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.089027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.41@tcp (source: 12345-192.168.204.41@tcp) 00000100:00100000:2.0:1789136116.089061:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696128256 00000100:00100000:2.0:1789136116.089070:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696128256 00000100:00100000:2.0:1789136116.089132:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127872 00000100:00100000:2.0:1789136116.089136:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127872 00000100:00100000:2.0:1789136116.089149:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696128128 00000100:00100000:2.0:1789136116.089151:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696128128 00000100:00100000:2.0:1789136116.089166:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:2.0:1789136116.089176:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696128256:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789136116.089267:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696128256:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136116.089275:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 18 00000100:00100000:2.0:1789136116.089304:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789136116.089312:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696127872:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789136116.089338:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+5:2365:x1876044696127872:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136116.089345:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 19 00000100:00100000:2.0:1789136116.089356:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00100000:2.0:1789136116.089362:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696128128:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:2.0:1789136116.089382:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:23916e5f-ff83-468e-b110-c2c4ea0abd4d+5:2365:x1876044696128128:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 21us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136116.089388:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 20 00000100:00080000:2.0:1789136116.089403:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136116.089407:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136116.089749:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127744 00000100:00100000:0.0:1789136116.089754:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127744 00000100:00100000:0.0:1789136116.089797:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696128000 00000100:00100000:0.0:1789136116.089800:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696128000 00000100:00100000:0.0:1789136116.089830:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:0.0:1789136116.089838:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+20:2365:x1876044696127744:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136116.089881:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4958cf40-dcb9-4063-84eb-d26b8ebcb17f+20:2365:x1876044696127744:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 45us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136116.089888:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 29 00000100:00100000:0.0:1789136116.089916:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:0.0:1789136116.089923:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba05c3e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2365:x1876044696128000:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:0.0:1789136116.089949:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba05c3e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:23916e5f-ff83-468e-b110-c2c4ea0abd4d+6:2365:x1876044696128000:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 28us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136116.089955:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 30 00000100:00100000:1.0:1789136116.090105:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044696127616 00000100:00100000:1.0:1789136116.090110:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044696127616 00000100:00100000:1.0:1789136116.090152:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00100000:1.0:1789136116.090160:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:2365:x1876044696127616:12345-192.168.204.41@tcp:400:kworker.0 00000100:00100000:1.0:1789136116.090191:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6cdb7e2-1b95-44f3-bcc7-c8db9f18010d+13:2365:x1876044696127616:12345-192.168.204.41@tcp:400:kworker.0 Request processed in 33us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136116.090197:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.41@tcp, seq: 124 00000100:00080000:2.0:1789136116.090394:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789136116.172963:0:14821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136117.124064:0:17108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789136117.197861:0:16066:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136117.455215:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723374336:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.455328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136117.455616:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723374592:0@lo:400:kworker.0 00000100:00100000:0.0:1789136117.455668:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374336 00000100:00100000:0.0:1789136117.455674:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374336 00000100:00100000:0.0:1789136117.455730:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789136117.455738:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0731c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:3312:x1876044723374336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.457727:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136117.457810:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136117.457823:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b9f46256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723374464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136117.457856:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136117.457901:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374464 00000100:00100000:3.0:1789136117.457909:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374464 00000100:00100000:3.0:1789136117.457959:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136117.457970:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723374464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136117.458008:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789136117.458055:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46255e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723374464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136117.458062:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789136117.458083:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136117.458112:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789136117.458118:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ba05c3e3c00, transno 8589934595 00000004:00080000:3.0:1789136117.458128:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789136117.458158:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b9f46256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723374464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136117.458683:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374592 00000100:00100000:3.0:1789136117.458689:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374592 00000100:00100000:3.0:1789136117.458769:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136117.458777:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723374592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.458834:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044723374592:12345-0@lo:400:kworker.0 Request processed in 58us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136117.458841:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789136117.458857:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136117.458883:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1876044723374592:0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.458938:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723374720:0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.458980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136117.459022:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374720 00000100:00100000:3.0:1789136117.459026:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374720 00000100:00100000:3.0:1789136117.459048:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136117.459054:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b9f46256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723374720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.459090:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b9f46256940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876044723374720:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136117.459097:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136117.459120:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1876044723374720:0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.463640:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723374976:0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.463729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136117.463809:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723375104:0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.463834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136117.463865:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374976 00000100:00100000:1.0:1789136117.463872:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374976 00000100:00100000:1.0:1789136117.463944:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723375104 00000100:00100000:1.0:1789136117.463948:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723375104 00000100:00100000:1.0:1789136117.463972:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136117.463982:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723374976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.464029:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044723374976:12345-0@lo:400:kworker.0 Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.464036:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136117.464324:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136117.464332:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723375104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.464385:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044723375104:12345-0@lo:400:kworker.0 Request processed in 53us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.464392:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136117.464437:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044723374976:0@lo:400:kworker.0 00000100:00080000:1.0:1789136117.464471:0:14829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136117.464488:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044723375104:0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.470031:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136117.470064:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723374848:0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.470146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136117.470221:0:15820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723374848 00000100:00100000:3.0:1789136117.470230:0:15820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723374848 00000100:00100000:3.0:1789136117.470290:0:15820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136117.470300:0:15820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723374848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136117.470358:0:15820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba085f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876044723374848:12345-0@lo:400:kworker.0 Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136117.470365:0:15820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136117.470412:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876044723374848:0@lo:400:kworker.0 00000100:00100000:0.0:1789136117.473507:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0731c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2dc02be1-e923-45bb-814e-7c82b120b447+19:3312:x1876044723374336:12345-0@lo:400:kworker.0 Request processed in 17760us (18169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136117.473523:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789136117.477229:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba085f121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2dc02be1-e923-45bb-814e-7c82b120b447:3312:1876044723374336:0@lo:400:kworker.0 00010000:00010000:1.0:1789136118.222799:0:14822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136118.994010:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136118.994032:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ba0580c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723375232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136118.994103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136118.994170:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044723375232 00000100:00100000:0.0:1789136118.994177:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044723375232 00000100:00100000:0.0:1789136118.994220:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136118.994228:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723375232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136118.994281:0:15522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789136118.994324:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ba0580c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044723375232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136118.994331:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136118.994373:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ba0580c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1876044723375232:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789136119.116957:0:14868:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136119.116966:0:14868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789136119.116997:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789136119.117004:0:14868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 30757 lines, 30757 kept, 0 dropped, 0 bad.